Aug 17 21:10:38 user nova-compute[72818]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 17 21:10:41 user nova-compute[72818]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72818) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 21:10:41 user nova-compute[72818]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72818) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 21:10:41 user nova-compute[72818]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72818) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 21:10:41 user nova-compute[72818]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 17 21:10:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:10:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:10:41 user nova-compute[72818]: INFO nova.virt.driver [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 17 21:10:42 user nova-compute[72818]: INFO nova.compute.provider_config [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] Acquiring lock "singleton_lock" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] Acquired lock "singleton_lock" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] Releasing lock "singleton_lock" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] Full set of CONF: {{(pid=72818) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ******************************************************************************** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] Configuration options gathered from: {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ================================================================================ {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] allow_resize_to_same_host      = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] arq_binding_timeout            = 300 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] backdoor_port                  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] backdoor_socket                = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] block_device_allocate_retries  = 300 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] block_device_allocate_retries_interval = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cert                           = self.pem {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute_monitors               = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] config_dir                     = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] config_drive_format            = iso9660 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] config_source                  = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] console_host                   = user {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] control_exchange               = nova {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cpu_allocation_ratio           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] daemon                         = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] debug                          = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] default_access_ip_network_name = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] default_availability_zone      = nova {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] default_ephemeral_format       = ext4 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] default_schedule_zone          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] disk_allocation_ratio          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] enable_new_services            = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] enabled_ssl_apis               = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] flat_injected                  = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] force_config_drive             = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] force_raw_images               = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] graceful_shutdown_timeout      = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] heal_instance_info_cache_interval = 60 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] host                           = user {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] instance_build_timeout         = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] instance_delete_interval       = 300 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] instance_name_template         = instance-%08x {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] instance_usage_audit           = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] instance_usage_audit_period    = month {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] internal_service_availability_zone = internal {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] key                            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] live_migration_retry_count     = 30 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] log_config_append              = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] log_dir                        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] log_file                       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] log_options                    = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] log_rotate_interval            = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] log_rotate_interval_type       = days {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] log_rotation_type              = none {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] long_rpc_timeout               = 1800 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] max_concurrent_builds          = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] max_concurrent_live_migrations = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] max_concurrent_snapshots       = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] max_local_block_devices        = 3 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] max_logfile_count              = 30 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] max_logfile_size_mb            = 200 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] maximum_instance_delete_attempts = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] metadata_listen                = 0.0.0.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] metadata_listen_port           = 8775 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] metadata_workers               = 3 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] migrate_max_retries            = -1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] mkisofs_cmd                    = genisoimage {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] my_ip                          = 10.0.0.210 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] network_allocate_retries       = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] osapi_compute_listen_port      = 8774 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] osapi_compute_unique_server_name_scope =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] osapi_compute_workers          = 3 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] password_length                = 12 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] periodic_enable                = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] periodic_fuzzy_delay           = 60 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] pointer_model                  = ps2mouse {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] preallocate_images             = none {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] publish_errors                 = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] pybasedir                      = /opt/stack/nova {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ram_allocation_ratio           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] rate_limit_burst               = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] rate_limit_except_level        = CRITICAL {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] rate_limit_interval            = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] reboot_timeout                 = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] reclaim_instance_interval      = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] record                         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] reimage_timeout_per_gb         = 60 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] report_interval                = 120 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] rescue_timeout                 = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] reserved_host_cpus             = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] reserved_host_disk_mb          = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] reserved_host_memory_mb        = 512 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] reserved_huge_pages            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] resize_confirm_window          = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] resize_fs_using_block_device   = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] resume_guests_state_on_host_boot = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] rpc_response_timeout           = 60 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] run_external_periodic_tasks    = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] running_deleted_instance_action = reap {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] running_deleted_instance_timeout = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] scheduler_instance_sync_interval = 120 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] service_down_time              = 720 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] servicegroup_driver            = db {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] shelved_offload_time           = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] shelved_poll_interval          = 3600 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] shutdown_timeout               = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] source_is_ipv6                 = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ssl_only                       = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] state_path                     = /opt/stack/data/nova {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] sync_power_state_interval      = 600 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] sync_power_state_pool_size     = 1000 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] syslog_log_facility            = LOG_USER {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] tempdir                        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] timeout_nbd                    = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] transport_url                  = **** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] update_resources_interval      = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] use_cow_images                 = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] use_eventlog                   = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] use_journal                    = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] use_json                       = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] use_rootwrap_daemon            = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] use_stderr                     = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] use_syslog                     = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vcpu_pin_set                   = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plugging_is_fatal          = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plugging_timeout           = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] virt_mkfs                      = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] volume_usage_poll_interval     = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] watch_log_file                 = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] web                            = /usr/share/spice-html5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_concurrency.disable_process_locking = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.auth_strategy              = keystone {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.compute_link_prefix        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.dhcp_domain                = novalocal {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.enable_instance_password   = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.glance_link_prefix         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.instance_list_per_project_cells = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.list_records_by_skipping_down_cells = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.local_metadata_per_cell    = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.max_limit                  = 1000 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.metadata_cache_expiration  = 15 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.neutron_default_tenant_id  = default {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.use_forwarded_for          = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.use_neutron_default_nets   = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.vendordata_dynamic_targets = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.vendordata_jsonfile_path   = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.backend_argument         = **** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.config_prefix            = cache.oslo {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.dead_timeout             = 60.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.debug_cache_backend      = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.enable_retry_client      = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.enable_socket_keepalive  = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.enabled                  = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.expiration_time          = 600 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.hashclient_retry_attempts = 2 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.memcache_dead_retry      = 300 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.memcache_password        =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.memcache_sasl_enabled    = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.memcache_username        =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.proxies                  = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.retry_attempts           = 2 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.retry_delay              = 0.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.socket_keepalive_count   = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.socket_keepalive_idle    = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.socket_keepalive_interval = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.tls_allowed_ciphers      = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.tls_cafile               = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.tls_certfile             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.tls_enabled              = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cache.tls_keyfile              = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.auth_section            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.auth_type               = password {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.cafile                  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.certfile                = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.collect_timing          = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.cross_az_attach         = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.debug                   = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.endpoint_template       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.http_retries            = 3 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.insecure                = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.keyfile                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.os_region_name          = RegionOne {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.split_loggers           = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cinder.timeout                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute.cpu_dedicated_set      = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute.cpu_shared_set         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute.image_type_exclude_list = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute.resource_provider_association_refresh = 300 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute.shutdown_retry_interval = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] conductor.workers              = 3 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] console.allowed_origins        = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] console.ssl_ciphers            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] console.ssl_minimum_version    = default {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] consoleauth.token_ttl          = 600 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.cafile                  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.certfile                = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.collect_timing          = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.connect_retries         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.connect_retry_delay     = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.endpoint_override       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.insecure                = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.keyfile                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.max_version             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.min_version             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.region_name             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.service_name            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.service_type            = accelerator {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.split_loggers           = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.status_code_retries     = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.status_code_retry_delay = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.timeout                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] cyborg.version                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.backend               = sqlalchemy {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.connection            = **** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.connection_debug      = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.connection_parameters =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.connection_recycle_time = 3600 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.connection_trace      = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.db_inc_retry_interval = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.db_max_retries        = 20 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.db_max_retry_interval = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.db_retry_interval     = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.max_overflow          = 50 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.max_pool_size         = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.max_retries           = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.mysql_enable_ndb      = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.mysql_wsrep_sync_wait = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.pool_timeout          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.retry_interval        = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.slave_connection      = **** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] database.sqlite_synchronous    = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.backend           = sqlalchemy {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.connection        = **** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.connection_debug  = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.connection_parameters =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.connection_recycle_time = 3600 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.connection_trace  = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.db_inc_retry_interval = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.db_max_retries    = 20 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.db_max_retry_interval = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.db_retry_interval = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.max_overflow      = 50 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.max_pool_size     = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.max_retries       = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.mysql_enable_ndb  = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.pool_timeout      = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.retry_interval    = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.slave_connection  = **** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] api_database.sqlite_synchronous = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] devices.enabled_mdev_types     = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ephemeral_storage_encryption.enabled = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.api_servers             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.cafile                  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.certfile                = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.collect_timing          = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.connect_retries         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.connect_retry_delay     = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.debug                   = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.default_trusted_certificate_ids = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.enable_certificate_validation = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.enable_rbd_download     = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.endpoint_override       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.insecure                = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.keyfile                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.max_version             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.min_version             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.num_retries             = 3 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.rbd_ceph_conf           =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.rbd_connect_timeout     = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.rbd_pool                =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.rbd_user                =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.region_name             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.service_name            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.service_type            = image {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.split_loggers           = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.status_code_retries     = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.status_code_retry_delay = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.timeout                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.verify_glance_signatures = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] glance.version                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] guestfs.debug                  = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.config_drive_cdrom      = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.config_drive_inject_password = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.enable_remotefx         = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.instances_path_share    =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.limit_cpu_features      = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.use_multipath_io        = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.vswitch_name            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] mks.enabled                    = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] image_cache.manager_interval   = 2400 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] image_cache.precache_concurrency = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] image_cache.remove_unused_base_images = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] image_cache.subdirectory_name  = _base {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.api_max_retries         = 60 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.api_retry_interval      = 2 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.auth_section            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.auth_type               = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.cafile                  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.certfile                = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.collect_timing          = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.connect_retries         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.connect_retry_delay     = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.endpoint_override       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.insecure                = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.keyfile                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.max_version             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.min_version             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.partition_key           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.peer_list               = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.region_name             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.serial_console_state_timeout = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.service_name            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.service_type            = baremetal {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.split_loggers           = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.status_code_retries     = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.status_code_retry_delay = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.timeout                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ironic.version                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] key_manager.fixed_key          = **** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.barbican_api_version  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.barbican_endpoint     = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.barbican_endpoint_type = public {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.barbican_region_name  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.cafile                = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.certfile              = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.collect_timing        = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.insecure              = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.keyfile               = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.number_of_retries     = 60 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.retry_delay           = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.send_service_user_token = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.split_loggers         = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.timeout               = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.verify_ssl            = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican.verify_ssl_path       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican_service_user.auth_section = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican_service_user.auth_type = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican_service_user.cafile   = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican_service_user.certfile = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican_service_user.collect_timing = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican_service_user.insecure = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican_service_user.keyfile  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican_service_user.split_loggers = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] barbican_service_user.timeout  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.approle_role_id          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.approle_secret_id        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.cafile                   = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.certfile                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.collect_timing           = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.insecure                 = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.keyfile                  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.kv_mountpoint            = secret {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.kv_version               = 2 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.namespace                = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.root_token_id            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.split_loggers            = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.ssl_ca_crt_file          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.timeout                  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.use_ssl                  = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.cafile                = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.certfile              = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.collect_timing        = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.connect_retries       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.connect_retry_delay   = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.endpoint_override     = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.insecure              = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.keyfile               = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.max_version           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.min_version           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.region_name           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.service_name          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.service_type          = identity {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.split_loggers         = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.status_code_retries   = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.status_code_retry_delay = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.timeout               = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] keystone.version               = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.connection_uri         =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.cpu_mode               = custom {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: WARNING oslo_config.cfg [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.cpu_power_governor_high = performance {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.cpu_power_management   = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.device_detach_attempts = 8 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.device_detach_timeout  = 20 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.disk_cachemodes        = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.disk_prefix            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.enabled_perf_events    = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.file_backed_memory     = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.gid_maps               = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.hw_disk_discard        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.hw_machine_type        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.images_rbd_pool        = rbd {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.images_type            = default {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.images_volume_group    = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.inject_key             = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.inject_partition       = -2 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.inject_password        = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.iscsi_iface            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.iser_use_multipath     = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_downtime = 500 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_inbound_addr = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_scheme  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_timeout_action = abort {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_tunnelled = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: WARNING oslo_config.cfg [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 17 21:10:42 user nova-compute[72818]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 17 21:10:42 user nova-compute[72818]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 17 21:10:42 user nova-compute[72818]: and ``live_migration_inbound_addr`` respectively.
Aug 17 21:10:42 user nova-compute[72818]: ).  Its value may be silently ignored in the future.
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.live_migration_with_native_tls = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.max_queues             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.nfs_mount_options      = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.num_pcie_ports         = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.pmem_namespaces        = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.quobyte_client_cfg     = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.rbd_secret_uuid        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.rbd_user               = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.rescue_image_id        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.rescue_kernel_id       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.rx_queue_size          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.smbfs_mount_options    =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.snapshot_compression   = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.snapshot_image_format  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.sparse_logical_volumes = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.swtpm_enabled          = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.swtpm_group            = tss {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.swtpm_user             = tss {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.sysinfo_serial         = unique {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.tb_cache_size          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.tx_queue_size          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.uid_maps               = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.use_virtio_for_bridges = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.virt_type              = kvm {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.volume_clear           = zero {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.volume_clear_size      = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.volume_use_multipath   = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.vzstorage_cache_path   = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.auth_section           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.auth_type              = password {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.cafile                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.certfile               = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.collect_timing         = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.connect_retries        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.connect_retry_delay    = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.default_floating_pool  = public {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.endpoint_override      = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.extension_sync_interval = 600 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.http_retries           = 3 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.insecure               = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.keyfile                = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.max_version            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.min_version            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.ovs_bridge             = br-int {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.physnets               = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.region_name            = RegionOne {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.service_metadata_proxy = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.service_name           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.service_type           = network {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.split_loggers          = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.status_code_retries    = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.status_code_retry_delay = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.timeout                = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] neutron.version                = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] notifications.bdms_in_notifications = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] notifications.default_level    = INFO {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] notifications.notification_format = unversioned {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] notifications.notify_on_state_change = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] pci.alias                      = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] pci.device_spec                = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] pci.report_in_placement        = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.auth_section         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.auth_type            = password {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.cafile               = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.certfile             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.collect_timing       = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.connect_retries      = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.connect_retry_delay  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.default_domain_id    = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.default_domain_name  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.domain_id            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.domain_name          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.endpoint_override    = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.insecure             = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.keyfile              = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.max_version          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.min_version          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.password             = **** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.project_domain_id    = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.project_domain_name  = Default {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.project_id           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.project_name         = service {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.region_name          = RegionOne {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.service_name         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.service_type         = placement {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.split_loggers        = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.status_code_retries  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.status_code_retry_delay = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.system_scope         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.timeout              = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.trust_id             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.user_domain_id       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.user_domain_name     = Default {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.user_id              = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.username             = placement {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] placement.version              = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.cores                    = 20 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.count_usage_from_placement = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.injected_file_content_bytes = 10240 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.injected_file_path_length = 255 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.injected_files           = 5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.instances                = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.key_pairs                = 100 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.metadata_items           = 128 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.ram                      = 51200 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.recheck_quota            = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.server_group_members     = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] quota.server_groups            = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] rdp.enabled                    = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] scheduler.image_metadata_prefilter = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] scheduler.max_attempts         = 3 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] scheduler.max_placement_results = 1000 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] scheduler.workers              = 3 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.host_subset_size = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.isolated_hosts = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.isolated_images = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.pci_in_placement = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.track_instance_changes = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] metrics.required               = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] metrics.weight_multiplier      = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] metrics.weight_setting         = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] serial_console.enabled         = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] serial_console.port_range      = 10000:20000 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] serial_console.serialproxy_port = 6083 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] service_user.auth_section      = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] service_user.auth_type         = password {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] service_user.cafile            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] service_user.certfile          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] service_user.collect_timing    = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] service_user.insecure          = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] service_user.keyfile           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] service_user.send_service_user_token = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] service_user.split_loggers     = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] service_user.timeout           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] spice.agent_enabled            = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] spice.enabled                  = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] spice.html5proxy_port          = 6082 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] spice.image_compression        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] spice.jpeg_compression         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] spice.playback_compression     = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] spice.server_listen            = 127.0.0.1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] spice.streaming_mode           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] spice.zlib_compression         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] upgrade_levels.baseapi         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] upgrade_levels.cert            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] upgrade_levels.compute         = auto {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] upgrade_levels.conductor       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] upgrade_levels.scheduler       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vendordata_dynamic_auth.cafile = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vendordata_dynamic_auth.certfile = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vendordata_dynamic_auth.insecure = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vendordata_dynamic_auth.timeout = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.api_retry_count         = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.ca_file                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.cache_prefix            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.cluster_name            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.connection_pool_size    = 10 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.console_delay_seconds   = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.datastore_regex         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.host_ip                 = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.host_password           = **** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.host_port               = 443 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.host_username           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.insecure                = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.integration_bridge      = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.maximum_objects         = 100 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.pbm_default_policy      = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.pbm_enabled             = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.pbm_wsdl_location       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.serial_port_proxy_uri   = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.serial_port_service_uri = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.task_poll_interval      = 0.5 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.use_linked_clone        = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.vnc_keymap              = en-us {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.vnc_port                = 5900 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vmware.vnc_port_total          = 10000 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vnc.auth_schemes               = ['none'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vnc.enabled                    = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vnc.novncproxy_port            = 6080 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vnc.vencrypt_ca_certs          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vnc.vencrypt_client_cert       = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vnc.vencrypt_client_key        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.disable_rootwrap   = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.enable_numa_live_migration = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.libvirt_disable_apic = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] wsgi.client_socket_timeout     = 900 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] wsgi.default_pool_size         = 1000 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] wsgi.keep_alive                = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] wsgi.max_header_line           = 16384 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] wsgi.ssl_ca_file               = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] wsgi.ssl_cert_file             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] wsgi.ssl_key_file              = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] wsgi.tcp_keepidle              = 600 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] zvm.ca_file                    = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] zvm.cloud_connector_url        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] zvm.reachable_timeout          = 300 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_policy.enforce_new_defaults = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_policy.enforce_scope      = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_policy.policy_default_rule = default {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler.connection_string     = messaging:// {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler.enabled               = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler.es_doc_type           = notification {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler.es_scroll_size        = 10000 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler.es_scroll_time        = 2m {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler.filter_error_trace    = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler.hmac_keys             = **** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler.sentinel_service_name = mymaster {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler.socket_timeout        = 0.1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler.trace_requests        = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler.trace_sqlalchemy      = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler_jaeger.process_tags   = {} {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler_jaeger.service_name_prefix = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] profiler_otlp.service_name_prefix = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] remote_debug.host              = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] remote_debug.port              = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_notifications.retry = -1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.auth_section        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.auth_type           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.cafile              = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.certfile            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.collect_timing      = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.connect_retries     = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.connect_retry_delay = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.endpoint_id         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.endpoint_override   = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.insecure            = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.keyfile             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.max_version         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.min_version         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.region_name         = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.service_name        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.service_type        = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.split_loggers       = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.status_code_retries = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.status_code_retry_delay = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.timeout             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.valid_interfaces    = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_limit.version             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_reports.file_event_handler = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] oslo_reports.log_dir           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plug_ovs_privileged.group  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] vif_plug_ovs_privileged.user   = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_ovs.isolate_vif         = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] os_brick.lock_path             = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] privsep_osbrick.capabilities   = [21] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] privsep_osbrick.group          = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] privsep_osbrick.helper_command = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] privsep_osbrick.user           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] nova_sys_admin.group           = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] nova_sys_admin.helper_command  = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] nova_sys_admin.user            = None {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG oslo_service.service [None req-6d01b914-ef91-485f-a236-af9f041703b0 None None] ******************************************************************************** {{(pid=72818) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 17 21:10:42 user nova-compute[72818]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 17 21:10:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Starting native event thread {{(pid=72818) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Starting green dispatch thread {{(pid=72818) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Starting connection event dispatch thread {{(pid=72818) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Connecting to libvirt: qemu:///system {{(pid=72818) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f8f4c7c4f70> {{(pid=72818) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 17 21:10:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f8f4c7c4f70> {{(pid=72818) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 17 21:10:42 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Connection event '1' reason 'None'
Aug 17 21:10:42 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 21:10:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.mount [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Initialising _HostMountState generation 0 {{(pid=72818) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 17 21:10:49 user nova-compute[72818]: INFO nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Libvirt host capabilities <capabilities>
Aug 17 21:10:49 user nova-compute[72818]:   <host>
Aug 17 21:10:49 user nova-compute[72818]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 17 21:10:49 user nova-compute[72818]:     <cpu>
Aug 17 21:10:49 user nova-compute[72818]:       <arch>x86_64</arch>
Aug 17 21:10:49 user nova-compute[72818]:       <model>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <vendor>Intel</vendor>
Aug 17 21:10:49 user nova-compute[72818]:       <microcode version='1070'/>
Aug 17 21:10:49 user nova-compute[72818]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 17 21:10:49 user nova-compute[72818]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='ss'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='vmx'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='pcid'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='osxsave'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='hypervisor'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='arat'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='tsc_adjust'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='md-clear'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='arch-capabilities'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='invtsc'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='rsba'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature name='skip-l1dfl-vmentry'/>
Aug 17 21:10:49 user nova-compute[72818]:       <pages unit='KiB' size='4'/>
Aug 17 21:10:49 user nova-compute[72818]:       <pages unit='KiB' size='2048'/>
Aug 17 21:10:49 user nova-compute[72818]:     </cpu>
Aug 17 21:10:49 user nova-compute[72818]:     <power_management>
Aug 17 21:10:49 user nova-compute[72818]:       <suspend_mem/>
Aug 17 21:10:49 user nova-compute[72818]:       <suspend_disk/>
Aug 17 21:10:49 user nova-compute[72818]:       <suspend_hybrid/>
Aug 17 21:10:49 user nova-compute[72818]:     </power_management>
Aug 17 21:10:49 user nova-compute[72818]:     <iommu support='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     <migration_features>
Aug 17 21:10:49 user nova-compute[72818]:       <live/>
Aug 17 21:10:49 user nova-compute[72818]:       <uri_transports>
Aug 17 21:10:49 user nova-compute[72818]:         <uri_transport>tcp</uri_transport>
Aug 17 21:10:49 user nova-compute[72818]:         <uri_transport>rdma</uri_transport>
Aug 17 21:10:49 user nova-compute[72818]:       </uri_transports>
Aug 17 21:10:49 user nova-compute[72818]:     </migration_features>
Aug 17 21:10:49 user nova-compute[72818]:     <topology>
Aug 17 21:10:49 user nova-compute[72818]:       <cells num='2'>
Aug 17 21:10:49 user nova-compute[72818]:         <cell id='0'>
Aug 17 21:10:49 user nova-compute[72818]:           <memory unit='KiB'>8189224</memory>
Aug 17 21:10:49 user nova-compute[72818]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 17 21:10:49 user nova-compute[72818]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 21:10:49 user nova-compute[72818]:           <distances>
Aug 17 21:10:49 user nova-compute[72818]:             <sibling id='0' value='10'/>
Aug 17 21:10:49 user nova-compute[72818]:             <sibling id='1' value='20'/>
Aug 17 21:10:49 user nova-compute[72818]:           </distances>
Aug 17 21:10:49 user nova-compute[72818]:           <cpus num='6'>
Aug 17 21:10:49 user nova-compute[72818]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 17 21:10:49 user nova-compute[72818]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 17 21:10:49 user nova-compute[72818]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 17 21:10:49 user nova-compute[72818]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 17 21:10:49 user nova-compute[72818]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 17 21:10:49 user nova-compute[72818]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 17 21:10:49 user nova-compute[72818]:           </cpus>
Aug 17 21:10:49 user nova-compute[72818]:         </cell>
Aug 17 21:10:49 user nova-compute[72818]:         <cell id='1'>
Aug 17 21:10:49 user nova-compute[72818]:           <memory unit='KiB'>8206460</memory>
Aug 17 21:10:49 user nova-compute[72818]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 17 21:10:49 user nova-compute[72818]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 21:10:49 user nova-compute[72818]:           <distances>
Aug 17 21:10:49 user nova-compute[72818]:             <sibling id='0' value='20'/>
Aug 17 21:10:49 user nova-compute[72818]:             <sibling id='1' value='10'/>
Aug 17 21:10:49 user nova-compute[72818]:           </distances>
Aug 17 21:10:49 user nova-compute[72818]:           <cpus num='6'>
Aug 17 21:10:49 user nova-compute[72818]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 17 21:10:49 user nova-compute[72818]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 17 21:10:49 user nova-compute[72818]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 17 21:10:49 user nova-compute[72818]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 17 21:10:49 user nova-compute[72818]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 17 21:10:49 user nova-compute[72818]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 17 21:10:49 user nova-compute[72818]:           </cpus>
Aug 17 21:10:49 user nova-compute[72818]:         </cell>
Aug 17 21:10:49 user nova-compute[72818]:       </cells>
Aug 17 21:10:49 user nova-compute[72818]:     </topology>
Aug 17 21:10:49 user nova-compute[72818]:     <cache>
Aug 17 21:10:49 user nova-compute[72818]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 17 21:10:49 user nova-compute[72818]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 17 21:10:49 user nova-compute[72818]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 17 21:10:49 user nova-compute[72818]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 17 21:10:49 user nova-compute[72818]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 17 21:10:49 user nova-compute[72818]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 17 21:10:49 user nova-compute[72818]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 17 21:10:49 user nova-compute[72818]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 17 21:10:49 user nova-compute[72818]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 17 21:10:49 user nova-compute[72818]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 17 21:10:49 user nova-compute[72818]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 17 21:10:49 user nova-compute[72818]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 17 21:10:49 user nova-compute[72818]:     </cache>
Aug 17 21:10:49 user nova-compute[72818]:     <secmodel>
Aug 17 21:10:49 user nova-compute[72818]:       <model>apparmor</model>
Aug 17 21:10:49 user nova-compute[72818]:       <doi>0</doi>
Aug 17 21:10:49 user nova-compute[72818]:     </secmodel>
Aug 17 21:10:49 user nova-compute[72818]:     <secmodel>
Aug 17 21:10:49 user nova-compute[72818]:       <model>dac</model>
Aug 17 21:10:49 user nova-compute[72818]:       <doi>0</doi>
Aug 17 21:10:49 user nova-compute[72818]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 17 21:10:49 user nova-compute[72818]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 17 21:10:49 user nova-compute[72818]:     </secmodel>
Aug 17 21:10:49 user nova-compute[72818]:   </host>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='alpha'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>64</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>clipper</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='armv6l'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>spitz</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>nuri</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>kzm</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sx1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>z2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>tosa</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>n810</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>n800</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>terrier</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>midway</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>microbit</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>verdex</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>highbank</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>akita</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>connex</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>collie</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='armv7l'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>spitz</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>nuri</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>kzm</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sx1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>z2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>tosa</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>n810</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>n800</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>terrier</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>midway</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>microbit</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>verdex</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>highbank</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>akita</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>connex</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>collie</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='aarch64'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>64</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>spitz</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>nuri</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>kzm</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sx1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>z2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>tosa</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>n810</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>n800</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>terrier</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>midway</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>microbit</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>verdex</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>raspi3b</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>highbank</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>akita</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>connex</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>collie</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <acpi default='on' toggle='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='cris'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='i686'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>isapc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>microvm</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='kvm'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <pae/>
Aug 17 21:10:49 user nova-compute[72818]:       <nonpae/>
Aug 17 21:10:49 user nova-compute[72818]:       <acpi default='on' toggle='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:       <apic default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='m68k'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>an5206</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>q800</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>next-cube</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='microblaze'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='microblazeel'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='mips'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='16'>malta</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='mipsel'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='16'>malta</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='mips64'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>64</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='16'>malta</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>pica61</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>magnum</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='mips64el'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>64</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='16'>malta</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>pica61</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>magnum</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='16'>boston</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='ppc'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mac99</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>40p</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>taihu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='ppc64'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>64</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>taihu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>40p</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mac99</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='ppc64le'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>64</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>taihu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>40p</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>mac99</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='riscv32'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='8'>spike</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>opentitan</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='8'>virt</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='riscv64'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>64</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='8'>spike</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>shakti_c</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='8'>virt</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='s390x'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>64</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='sh4'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>shix</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>r2d</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='sh4eb'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>64</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>shix</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>r2d</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='sparc'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>SS-5</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>SS-20</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>LX</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>SS-4</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>SS-10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>Voyager</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='sparc64'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>64</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sun4u</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>niagara</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>sun4v</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='x86_64'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>64</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='1'>isapc</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>microvm</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='kvm'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <acpi default='on' toggle='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:       <apic default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='xtensa'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>sim</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>kc705</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>ml605</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>virt</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>lx200</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>lx60</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]:   <guest>
Aug 17 21:10:49 user nova-compute[72818]:     <os_type>hvm</os_type>
Aug 17 21:10:49 user nova-compute[72818]:     <arch name='xtensaeb'>
Aug 17 21:10:49 user nova-compute[72818]:       <wordsize>32</wordsize>
Aug 17 21:10:49 user nova-compute[72818]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='4'>sim</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>kc705</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>ml605</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>virt</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>lx200</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>lx60</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 21:10:49 user nova-compute[72818]:       <domain type='qemu'/>
Aug 17 21:10:49 user nova-compute[72818]:     </arch>
Aug 17 21:10:49 user nova-compute[72818]:     <features>
Aug 17 21:10:49 user nova-compute[72818]:       <cpuselection/>
Aug 17 21:10:49 user nova-compute[72818]:       <deviceboot/>
Aug 17 21:10:49 user nova-compute[72818]:       <disksnapshot default='on' toggle='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     </features>
Aug 17 21:10:49 user nova-compute[72818]:   </guest>
Aug 17 21:10:49 user nova-compute[72818]: </capabilities>
Aug 17 21:10:49 user nova-compute[72818]: 
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 17 21:10:49 user nova-compute[72818]: <domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 21:10:49 user nova-compute[72818]:   <domain>kvm</domain>
Aug 17 21:10:49 user nova-compute[72818]:   <machine>pc-i440fx-jammy</machine>
Aug 17 21:10:49 user nova-compute[72818]:   <arch>i686</arch>
Aug 17 21:10:49 user nova-compute[72818]:   <vcpu max='255'/>
Aug 17 21:10:49 user nova-compute[72818]:   <iothreads supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:   <os supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='firmware'/>
Aug 17 21:10:49 user nova-compute[72818]:     <loader supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>rom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pflash</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='readonly'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>yes</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='secure'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </loader>
Aug 17 21:10:49 user nova-compute[72818]:   </os>
Aug 17 21:10:49 user nova-compute[72818]:   <cpu>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-passthrough' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='hostPassthroughMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='maximum' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='maximumMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>on</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-model' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <vendor>Intel</vendor>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ss'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='vmx'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='pcid'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='hypervisor'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arat'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='umip'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='md-clear'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibpb'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibrs'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='erms'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='lm'/>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='custom' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>qemu64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>qemu32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>phenom</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>n270</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>kvm64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>kvm32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>coreduo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>core2duo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>athlon</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Westmere</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Snowridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Penryn</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G5</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G4</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G1</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Nehalem</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Rome</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Milan</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Dhyana</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cooperlake</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Conroe</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>486</model>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:   </cpu>
Aug 17 21:10:49 user nova-compute[72818]:   <memoryBacking supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='sourceType'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>file</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>anonymous</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>memfd</value>
Aug 17 21:10:49 user nova-compute[72818]:     </enum>
Aug 17 21:10:49 user nova-compute[72818]:   </memoryBacking>
Aug 17 21:10:49 user nova-compute[72818]:   <devices>
Aug 17 21:10:49 user nova-compute[72818]:     <disk supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='diskDevice'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>disk</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cdrom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>floppy</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>lun</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='bus'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>ide</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>fdc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sata</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </disk>
Aug 17 21:10:49 user nova-compute[72818]:     <graphics supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sdl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vnc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>spice</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egl-headless</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </graphics>
Aug 17 21:10:49 user nova-compute[72818]:     <video supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='modelType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cirrus</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vmvga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>qxl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>none</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>bochs</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>ramfb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </video>
Aug 17 21:10:49 user nova-compute[72818]:     <hostdev supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='mode'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>subsystem</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='startupPolicy'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>default</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>mandatory</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>requisite</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>optional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='subsysType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pci</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='capsType'/>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='pciBackend'/>
Aug 17 21:10:49 user nova-compute[72818]:     </hostdev>
Aug 17 21:10:49 user nova-compute[72818]:     <rng supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>random</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egd</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>builtin</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </rng>
Aug 17 21:10:49 user nova-compute[72818]:     <filesystem supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='driverType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>path</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>handle</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtiofs</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </filesystem>
Aug 17 21:10:49 user nova-compute[72818]:     <tpm supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-tis</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-crb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>passthrough</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>emulator</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </tpm>
Aug 17 21:10:49 user nova-compute[72818]:   </devices>
Aug 17 21:10:49 user nova-compute[72818]:   <features>
Aug 17 21:10:49 user nova-compute[72818]:     <gic supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     <vmcoreinfo supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <genid supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backingStoreInput supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backup supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <sev supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:   </features>
Aug 17 21:10:49 user nova-compute[72818]: </domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:  {{(pid=72818) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 17 21:10:49 user nova-compute[72818]: <domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 21:10:49 user nova-compute[72818]:   <domain>kvm</domain>
Aug 17 21:10:49 user nova-compute[72818]:   <machine>pc-i440fx-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:   <arch>i686</arch>
Aug 17 21:10:49 user nova-compute[72818]:   <vcpu max='255'/>
Aug 17 21:10:49 user nova-compute[72818]:   <iothreads supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:   <os supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='firmware'/>
Aug 17 21:10:49 user nova-compute[72818]:     <loader supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>rom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pflash</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='readonly'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>yes</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='secure'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </loader>
Aug 17 21:10:49 user nova-compute[72818]:   </os>
Aug 17 21:10:49 user nova-compute[72818]:   <cpu>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-passthrough' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='hostPassthroughMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='maximum' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='maximumMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>on</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-model' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <vendor>Intel</vendor>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ss'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='vmx'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='pcid'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='hypervisor'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arat'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='umip'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='md-clear'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibpb'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibrs'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='erms'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='lm'/>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='custom' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>qemu64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>qemu32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>phenom</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>n270</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>kvm64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>kvm32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>coreduo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>core2duo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>athlon</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Westmere</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Snowridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Penryn</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G5</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G4</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G1</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Nehalem</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Rome</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Milan</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Dhyana</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cooperlake</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Conroe</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>486</model>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:   </cpu>
Aug 17 21:10:49 user nova-compute[72818]:   <memoryBacking supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='sourceType'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>file</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>anonymous</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>memfd</value>
Aug 17 21:10:49 user nova-compute[72818]:     </enum>
Aug 17 21:10:49 user nova-compute[72818]:   </memoryBacking>
Aug 17 21:10:49 user nova-compute[72818]:   <devices>
Aug 17 21:10:49 user nova-compute[72818]:     <disk supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='diskDevice'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>disk</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cdrom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>floppy</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>lun</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='bus'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>ide</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>fdc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sata</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </disk>
Aug 17 21:10:49 user nova-compute[72818]:     <graphics supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sdl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vnc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>spice</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egl-headless</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </graphics>
Aug 17 21:10:49 user nova-compute[72818]:     <video supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='modelType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cirrus</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vmvga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>qxl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>none</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>bochs</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>ramfb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </video>
Aug 17 21:10:49 user nova-compute[72818]:     <hostdev supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='mode'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>subsystem</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='startupPolicy'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>default</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>mandatory</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>requisite</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>optional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='subsysType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pci</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='capsType'/>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='pciBackend'/>
Aug 17 21:10:49 user nova-compute[72818]:     </hostdev>
Aug 17 21:10:49 user nova-compute[72818]:     <rng supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>random</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egd</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>builtin</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </rng>
Aug 17 21:10:49 user nova-compute[72818]:     <filesystem supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='driverType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>path</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>handle</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtiofs</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </filesystem>
Aug 17 21:10:49 user nova-compute[72818]:     <tpm supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-tis</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-crb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>passthrough</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>emulator</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </tpm>
Aug 17 21:10:49 user nova-compute[72818]:   </devices>
Aug 17 21:10:49 user nova-compute[72818]:   <features>
Aug 17 21:10:49 user nova-compute[72818]:     <gic supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     <vmcoreinfo supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <genid supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backingStoreInput supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backup supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <sev supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:   </features>
Aug 17 21:10:49 user nova-compute[72818]: </domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:  {{(pid=72818) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 17 21:10:49 user nova-compute[72818]: <domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 21:10:49 user nova-compute[72818]:   <domain>kvm</domain>
Aug 17 21:10:49 user nova-compute[72818]:   <machine>pc-q35-jammy</machine>
Aug 17 21:10:49 user nova-compute[72818]:   <arch>i686</arch>
Aug 17 21:10:49 user nova-compute[72818]:   <vcpu max='288'/>
Aug 17 21:10:49 user nova-compute[72818]:   <iothreads supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:   <os supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='firmware'/>
Aug 17 21:10:49 user nova-compute[72818]:     <loader supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>rom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pflash</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='readonly'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>yes</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='secure'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </loader>
Aug 17 21:10:49 user nova-compute[72818]:   </os>
Aug 17 21:10:49 user nova-compute[72818]:   <cpu>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-passthrough' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='hostPassthroughMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='maximum' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='maximumMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>on</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-model' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <vendor>Intel</vendor>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ss'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='vmx'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='pcid'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='hypervisor'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arat'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='umip'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='md-clear'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibpb'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibrs'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='erms'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='lm'/>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='custom' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>qemu64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>qemu32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>phenom</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>n270</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>kvm64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>kvm32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>coreduo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>core2duo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>athlon</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Westmere</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Snowridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Penryn</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G5</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G4</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G1</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Nehalem</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Rome</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Milan</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Dhyana</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cooperlake</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Conroe</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>486</model>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:   </cpu>
Aug 17 21:10:49 user nova-compute[72818]:   <memoryBacking supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='sourceType'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>file</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>anonymous</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>memfd</value>
Aug 17 21:10:49 user nova-compute[72818]:     </enum>
Aug 17 21:10:49 user nova-compute[72818]:   </memoryBacking>
Aug 17 21:10:49 user nova-compute[72818]:   <devices>
Aug 17 21:10:49 user nova-compute[72818]:     <disk supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='diskDevice'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>disk</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cdrom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>floppy</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>lun</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='bus'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>fdc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sata</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </disk>
Aug 17 21:10:49 user nova-compute[72818]:     <graphics supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sdl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vnc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>spice</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egl-headless</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </graphics>
Aug 17 21:10:49 user nova-compute[72818]:     <video supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='modelType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cirrus</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vmvga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>qxl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>none</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>bochs</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>ramfb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </video>
Aug 17 21:10:49 user nova-compute[72818]:     <hostdev supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='mode'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>subsystem</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='startupPolicy'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>default</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>mandatory</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>requisite</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>optional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='subsysType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pci</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='capsType'/>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='pciBackend'/>
Aug 17 21:10:49 user nova-compute[72818]:     </hostdev>
Aug 17 21:10:49 user nova-compute[72818]:     <rng supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>random</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egd</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>builtin</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </rng>
Aug 17 21:10:49 user nova-compute[72818]:     <filesystem supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='driverType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>path</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>handle</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtiofs</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </filesystem>
Aug 17 21:10:49 user nova-compute[72818]:     <tpm supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-tis</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-crb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>passthrough</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>emulator</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </tpm>
Aug 17 21:10:49 user nova-compute[72818]:   </devices>
Aug 17 21:10:49 user nova-compute[72818]:   <features>
Aug 17 21:10:49 user nova-compute[72818]:     <gic supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     <vmcoreinfo supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <genid supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backingStoreInput supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backup supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <sev supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:   </features>
Aug 17 21:10:49 user nova-compute[72818]: </domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:  {{(pid=72818) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 17 21:10:49 user nova-compute[72818]: <domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 21:10:49 user nova-compute[72818]:   <domain>kvm</domain>
Aug 17 21:10:49 user nova-compute[72818]:   <machine>pc-q35-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:   <arch>i686</arch>
Aug 17 21:10:49 user nova-compute[72818]:   <vcpu max='288'/>
Aug 17 21:10:49 user nova-compute[72818]:   <iothreads supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:   <os supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='firmware'/>
Aug 17 21:10:49 user nova-compute[72818]:     <loader supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>rom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pflash</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='readonly'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>yes</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='secure'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </loader>
Aug 17 21:10:49 user nova-compute[72818]:   </os>
Aug 17 21:10:49 user nova-compute[72818]:   <cpu>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-passthrough' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='hostPassthroughMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='maximum' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='maximumMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>on</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-model' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <vendor>Intel</vendor>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ss'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='vmx'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='pcid'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='hypervisor'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arat'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='umip'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='md-clear'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibpb'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibrs'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='erms'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='lm'/>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='custom' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>qemu64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>qemu32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>phenom</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>n270</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>kvm64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>kvm32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>coreduo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>core2duo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>athlon</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Westmere</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Snowridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Penryn</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G5</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G4</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G1</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Nehalem</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Rome</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Milan</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Dhyana</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cooperlake</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Conroe</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>486</model>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:   </cpu>
Aug 17 21:10:49 user nova-compute[72818]:   <memoryBacking supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='sourceType'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>file</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>anonymous</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>memfd</value>
Aug 17 21:10:49 user nova-compute[72818]:     </enum>
Aug 17 21:10:49 user nova-compute[72818]:   </memoryBacking>
Aug 17 21:10:49 user nova-compute[72818]:   <devices>
Aug 17 21:10:49 user nova-compute[72818]:     <disk supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='diskDevice'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>disk</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cdrom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>floppy</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>lun</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='bus'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>fdc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sata</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </disk>
Aug 17 21:10:49 user nova-compute[72818]:     <graphics supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sdl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vnc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>spice</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egl-headless</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </graphics>
Aug 17 21:10:49 user nova-compute[72818]:     <video supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='modelType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cirrus</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vmvga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>qxl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>none</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>bochs</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>ramfb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </video>
Aug 17 21:10:49 user nova-compute[72818]:     <hostdev supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='mode'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>subsystem</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='startupPolicy'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>default</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>mandatory</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>requisite</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>optional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='subsysType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pci</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='capsType'/>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='pciBackend'/>
Aug 17 21:10:49 user nova-compute[72818]:     </hostdev>
Aug 17 21:10:49 user nova-compute[72818]:     <rng supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>random</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egd</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>builtin</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </rng>
Aug 17 21:10:49 user nova-compute[72818]:     <filesystem supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='driverType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>path</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>handle</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtiofs</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </filesystem>
Aug 17 21:10:49 user nova-compute[72818]:     <tpm supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-tis</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-crb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>passthrough</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>emulator</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </tpm>
Aug 17 21:10:49 user nova-compute[72818]:   </devices>
Aug 17 21:10:49 user nova-compute[72818]:   <features>
Aug 17 21:10:49 user nova-compute[72818]:     <gic supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     <vmcoreinfo supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <genid supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backingStoreInput supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backup supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <sev supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:   </features>
Aug 17 21:10:49 user nova-compute[72818]: </domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:  {{(pid=72818) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 17 21:10:49 user nova-compute[72818]: <domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 21:10:49 user nova-compute[72818]:   <domain>kvm</domain>
Aug 17 21:10:49 user nova-compute[72818]:   <machine>pc-i440fx-jammy</machine>
Aug 17 21:10:49 user nova-compute[72818]:   <arch>x86_64</arch>
Aug 17 21:10:49 user nova-compute[72818]:   <vcpu max='255'/>
Aug 17 21:10:49 user nova-compute[72818]:   <iothreads supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:   <os supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='firmware'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>efi</value>
Aug 17 21:10:49 user nova-compute[72818]:     </enum>
Aug 17 21:10:49 user nova-compute[72818]:     <loader supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>rom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pflash</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='readonly'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>yes</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='secure'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </loader>
Aug 17 21:10:49 user nova-compute[72818]:   </os>
Aug 17 21:10:49 user nova-compute[72818]:   <cpu>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-passthrough' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='hostPassthroughMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>on</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='maximum' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='maximumMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>on</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-model' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <vendor>Intel</vendor>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ss'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='vmx'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='pcid'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='hypervisor'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arat'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='umip'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='md-clear'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='invtsc'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibpb'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibrs'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='rsba'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='erms'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='custom' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>qemu64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>qemu32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>phenom</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>n270</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>kvm64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>kvm32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>coreduo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>core2duo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>athlon</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Westmere</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Snowridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Penryn</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G5</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G4</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Opteron_G1</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Nehalem</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Rome</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Milan</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Dhyana</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cooperlake</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Conroe</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>486</model>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:   </cpu>
Aug 17 21:10:49 user nova-compute[72818]:   <memoryBacking supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='sourceType'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>file</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>anonymous</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>memfd</value>
Aug 17 21:10:49 user nova-compute[72818]:     </enum>
Aug 17 21:10:49 user nova-compute[72818]:   </memoryBacking>
Aug 17 21:10:49 user nova-compute[72818]:   <devices>
Aug 17 21:10:49 user nova-compute[72818]:     <disk supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='diskDevice'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>disk</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cdrom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>floppy</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>lun</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='bus'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>ide</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>fdc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sata</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </disk>
Aug 17 21:10:49 user nova-compute[72818]:     <graphics supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sdl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vnc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>spice</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egl-headless</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </graphics>
Aug 17 21:10:49 user nova-compute[72818]:     <video supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='modelType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cirrus</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vmvga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>qxl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>none</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>bochs</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>ramfb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </video>
Aug 17 21:10:49 user nova-compute[72818]:     <hostdev supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='mode'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>subsystem</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='startupPolicy'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>default</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>mandatory</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>requisite</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>optional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='subsysType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pci</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='capsType'/>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='pciBackend'/>
Aug 17 21:10:49 user nova-compute[72818]:     </hostdev>
Aug 17 21:10:49 user nova-compute[72818]:     <rng supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>random</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egd</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>builtin</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </rng>
Aug 17 21:10:49 user nova-compute[72818]:     <filesystem supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='driverType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>path</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>handle</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtiofs</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </filesystem>
Aug 17 21:10:49 user nova-compute[72818]:     <tpm supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-tis</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-crb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>passthrough</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>emulator</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </tpm>
Aug 17 21:10:49 user nova-compute[72818]:   </devices>
Aug 17 21:10:49 user nova-compute[72818]:   <features>
Aug 17 21:10:49 user nova-compute[72818]:     <gic supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     <vmcoreinfo supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <genid supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backingStoreInput supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backup supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <sev supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:   </features>
Aug 17 21:10:49 user nova-compute[72818]: </domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:  {{(pid=72818) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 17 21:10:49 user nova-compute[72818]: <domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 21:10:49 user nova-compute[72818]:   <domain>kvm</domain>
Aug 17 21:10:49 user nova-compute[72818]:   <machine>pc-i440fx-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:   <arch>x86_64</arch>
Aug 17 21:10:49 user nova-compute[72818]:   <vcpu max='255'/>
Aug 17 21:10:49 user nova-compute[72818]:   <iothreads supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:   <os supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='firmware'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>efi</value>
Aug 17 21:10:49 user nova-compute[72818]:     </enum>
Aug 17 21:10:49 user nova-compute[72818]:     <loader supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>rom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pflash</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='readonly'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>yes</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='secure'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </loader>
Aug 17 21:10:49 user nova-compute[72818]:   </os>
Aug 17 21:10:49 user nova-compute[72818]:   <cpu>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-passthrough' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='hostPassthroughMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>on</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='maximum' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='maximumMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>on</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-model' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <vendor>Intel</vendor>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ss'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='vmx'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='pcid'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='hypervisor'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arat'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='umip'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='md-clear'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='invtsc'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibpb'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibrs'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='rsba'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='erms'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='custom' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>qemu64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>qemu32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>phenom</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>n270</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>kvm64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>kvm32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>coreduo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>core2duo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>athlon</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Westmere</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Snowridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Penryn</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G5</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G4</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Opteron_G1</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Nehalem</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Rome</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Milan</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Dhyana</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cooperlake</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Conroe</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>486</model>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:   </cpu>
Aug 17 21:10:49 user nova-compute[72818]:   <memoryBacking supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='sourceType'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>file</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>anonymous</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>memfd</value>
Aug 17 21:10:49 user nova-compute[72818]:     </enum>
Aug 17 21:10:49 user nova-compute[72818]:   </memoryBacking>
Aug 17 21:10:49 user nova-compute[72818]:   <devices>
Aug 17 21:10:49 user nova-compute[72818]:     <disk supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='diskDevice'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>disk</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cdrom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>floppy</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>lun</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='bus'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>ide</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>fdc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sata</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </disk>
Aug 17 21:10:49 user nova-compute[72818]:     <graphics supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sdl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vnc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>spice</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egl-headless</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </graphics>
Aug 17 21:10:49 user nova-compute[72818]:     <video supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='modelType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cirrus</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vmvga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>qxl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>none</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>bochs</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>ramfb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </video>
Aug 17 21:10:49 user nova-compute[72818]:     <hostdev supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='mode'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>subsystem</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='startupPolicy'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>default</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>mandatory</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>requisite</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>optional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='subsysType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pci</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='capsType'/>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='pciBackend'/>
Aug 17 21:10:49 user nova-compute[72818]:     </hostdev>
Aug 17 21:10:49 user nova-compute[72818]:     <rng supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>random</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egd</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>builtin</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </rng>
Aug 17 21:10:49 user nova-compute[72818]:     <filesystem supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='driverType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>path</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>handle</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtiofs</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </filesystem>
Aug 17 21:10:49 user nova-compute[72818]:     <tpm supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-tis</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-crb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>passthrough</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>emulator</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </tpm>
Aug 17 21:10:49 user nova-compute[72818]:   </devices>
Aug 17 21:10:49 user nova-compute[72818]:   <features>
Aug 17 21:10:49 user nova-compute[72818]:     <gic supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     <vmcoreinfo supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <genid supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backingStoreInput supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backup supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <sev supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:   </features>
Aug 17 21:10:49 user nova-compute[72818]: </domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:  {{(pid=72818) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 17 21:10:49 user nova-compute[72818]: <domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 21:10:49 user nova-compute[72818]:   <domain>kvm</domain>
Aug 17 21:10:49 user nova-compute[72818]:   <machine>pc-q35-jammy</machine>
Aug 17 21:10:49 user nova-compute[72818]:   <arch>x86_64</arch>
Aug 17 21:10:49 user nova-compute[72818]:   <vcpu max='288'/>
Aug 17 21:10:49 user nova-compute[72818]:   <iothreads supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:   <os supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='firmware'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>efi</value>
Aug 17 21:10:49 user nova-compute[72818]:     </enum>
Aug 17 21:10:49 user nova-compute[72818]:     <loader supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>rom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pflash</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='readonly'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>yes</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='secure'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>yes</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </loader>
Aug 17 21:10:49 user nova-compute[72818]:   </os>
Aug 17 21:10:49 user nova-compute[72818]:   <cpu>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-passthrough' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='hostPassthroughMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>on</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='maximum' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='maximumMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>on</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-model' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <vendor>Intel</vendor>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ss'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='vmx'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='pcid'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='hypervisor'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arat'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='umip'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='md-clear'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='invtsc'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibpb'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibrs'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='rsba'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='erms'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='custom' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>qemu64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>qemu32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>phenom</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>n270</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>kvm64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>kvm32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>coreduo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>core2duo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>athlon</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Westmere</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Snowridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Penryn</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G5</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G4</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Opteron_G1</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Nehalem</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Rome</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Milan</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Dhyana</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cooperlake</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Conroe</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>486</model>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:   </cpu>
Aug 17 21:10:49 user nova-compute[72818]:   <memoryBacking supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='sourceType'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>file</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>anonymous</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>memfd</value>
Aug 17 21:10:49 user nova-compute[72818]:     </enum>
Aug 17 21:10:49 user nova-compute[72818]:   </memoryBacking>
Aug 17 21:10:49 user nova-compute[72818]:   <devices>
Aug 17 21:10:49 user nova-compute[72818]:     <disk supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='diskDevice'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>disk</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cdrom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>floppy</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>lun</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='bus'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>fdc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sata</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </disk>
Aug 17 21:10:49 user nova-compute[72818]:     <graphics supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sdl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vnc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>spice</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egl-headless</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </graphics>
Aug 17 21:10:49 user nova-compute[72818]:     <video supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='modelType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cirrus</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vmvga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>qxl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>none</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>bochs</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>ramfb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </video>
Aug 17 21:10:49 user nova-compute[72818]:     <hostdev supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='mode'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>subsystem</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='startupPolicy'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>default</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>mandatory</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>requisite</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>optional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='subsysType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pci</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='capsType'/>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='pciBackend'/>
Aug 17 21:10:49 user nova-compute[72818]:     </hostdev>
Aug 17 21:10:49 user nova-compute[72818]:     <rng supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>random</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egd</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>builtin</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </rng>
Aug 17 21:10:49 user nova-compute[72818]:     <filesystem supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='driverType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>path</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>handle</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtiofs</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </filesystem>
Aug 17 21:10:49 user nova-compute[72818]:     <tpm supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-tis</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-crb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>passthrough</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>emulator</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </tpm>
Aug 17 21:10:49 user nova-compute[72818]:   </devices>
Aug 17 21:10:49 user nova-compute[72818]:   <features>
Aug 17 21:10:49 user nova-compute[72818]:     <gic supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     <vmcoreinfo supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <genid supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backingStoreInput supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backup supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <sev supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:   </features>
Aug 17 21:10:49 user nova-compute[72818]: </domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:  {{(pid=72818) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 17 21:10:49 user nova-compute[72818]: <domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 21:10:49 user nova-compute[72818]:   <domain>kvm</domain>
Aug 17 21:10:49 user nova-compute[72818]:   <machine>pc-q35-6.2</machine>
Aug 17 21:10:49 user nova-compute[72818]:   <arch>x86_64</arch>
Aug 17 21:10:49 user nova-compute[72818]:   <vcpu max='288'/>
Aug 17 21:10:49 user nova-compute[72818]:   <iothreads supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:   <os supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='firmware'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>efi</value>
Aug 17 21:10:49 user nova-compute[72818]:     </enum>
Aug 17 21:10:49 user nova-compute[72818]:     <loader supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>rom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pflash</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='readonly'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>yes</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='secure'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>yes</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>no</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </loader>
Aug 17 21:10:49 user nova-compute[72818]:   </os>
Aug 17 21:10:49 user nova-compute[72818]:   <cpu>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-passthrough' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='hostPassthroughMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>on</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='maximum' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='maximumMigratable'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>on</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>off</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='host-model' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <vendor>Intel</vendor>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ss'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='vmx'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='pcid'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='hypervisor'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arat'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='umip'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='md-clear'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='invtsc'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibpb'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='ibrs'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-stibp'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='rsba'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='erms'/>
Aug 17 21:10:49 user nova-compute[72818]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:     <mode name='custom' supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>qemu64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>qemu32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>phenom</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>pentium</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>n270</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>kvm64</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>kvm32</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>coreduo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>core2duo</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>athlon</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Westmere</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Snowridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Skylake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>SandyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Penryn</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G5</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G4</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G3</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Opteron_G2</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Opteron_G1</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Nehalem</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>IvyBridge</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Icelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Haswell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Rome</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-Milan</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>EPYC</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Dhyana</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cooperlake</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>Conroe</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='no'>Broadwell</model>
Aug 17 21:10:49 user nova-compute[72818]:       <model usable='yes'>486</model>
Aug 17 21:10:49 user nova-compute[72818]:     </mode>
Aug 17 21:10:49 user nova-compute[72818]:   </cpu>
Aug 17 21:10:49 user nova-compute[72818]:   <memoryBacking supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:     <enum name='sourceType'>
Aug 17 21:10:49 user nova-compute[72818]:       <value>file</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>anonymous</value>
Aug 17 21:10:49 user nova-compute[72818]:       <value>memfd</value>
Aug 17 21:10:49 user nova-compute[72818]:     </enum>
Aug 17 21:10:49 user nova-compute[72818]:   </memoryBacking>
Aug 17 21:10:49 user nova-compute[72818]:   <devices>
Aug 17 21:10:49 user nova-compute[72818]:     <disk supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='diskDevice'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>disk</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cdrom</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>floppy</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>lun</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='bus'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>fdc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sata</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </disk>
Aug 17 21:10:49 user nova-compute[72818]:     <graphics supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='type'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>sdl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vnc</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>spice</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egl-headless</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </graphics>
Aug 17 21:10:49 user nova-compute[72818]:     <video supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='modelType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>cirrus</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>vmvga</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>qxl</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>none</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>bochs</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>ramfb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </video>
Aug 17 21:10:49 user nova-compute[72818]:     <hostdev supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='mode'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>subsystem</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='startupPolicy'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>default</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>mandatory</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>requisite</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>optional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='subsysType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>usb</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>pci</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>scsi</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='capsType'/>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='pciBackend'/>
Aug 17 21:10:49 user nova-compute[72818]:     </hostdev>
Aug 17 21:10:49 user nova-compute[72818]:     <rng supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtio-non-transitional</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>random</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>egd</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>builtin</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </rng>
Aug 17 21:10:49 user nova-compute[72818]:     <filesystem supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='driverType'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>path</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>handle</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>virtiofs</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </filesystem>
Aug 17 21:10:49 user nova-compute[72818]:     <tpm supported='yes'>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='model'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-tis</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>tpm-crb</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:       <enum name='backendModel'>
Aug 17 21:10:49 user nova-compute[72818]:         <value>passthrough</value>
Aug 17 21:10:49 user nova-compute[72818]:         <value>emulator</value>
Aug 17 21:10:49 user nova-compute[72818]:       </enum>
Aug 17 21:10:49 user nova-compute[72818]:     </tpm>
Aug 17 21:10:49 user nova-compute[72818]:   </devices>
Aug 17 21:10:49 user nova-compute[72818]:   <features>
Aug 17 21:10:49 user nova-compute[72818]:     <gic supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:     <vmcoreinfo supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <genid supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backingStoreInput supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <backup supported='yes'/>
Aug 17 21:10:49 user nova-compute[72818]:     <sev supported='no'/>
Aug 17 21:10:49 user nova-compute[72818]:   </features>
Aug 17 21:10:49 user nova-compute[72818]: </domainCapabilities>
Aug 17 21:10:49 user nova-compute[72818]:  {{(pid=72818) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72818) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72818) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Checking secure boot support for host arch (x86_64) {{(pid=72818) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Checking secure boot support for host arch (x86_64) {{(pid=72818) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Checking secure boot support for host arch (x86_64) {{(pid=72818) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Checking secure boot support for host arch (x86_64) {{(pid=72818) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Checking secure boot support for host arch (x86_64) {{(pid=72818) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 21:10:49 user nova-compute[72818]: INFO nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Secure Boot support detected
Aug 17 21:10:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] cpu compare xml: <cpu match="exact">
Aug 17 21:10:49 user nova-compute[72818]:   <model>Nehalem</model>
Aug 17 21:10:49 user nova-compute[72818]: </cpu>
Aug 17 21:10:49 user nova-compute[72818]:  {{(pid=72818) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 17 21:10:49 user nova-compute[72818]: INFO nova.virt.node [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Generated node identity d156e3af-684d-47e1-a951-585f9c95fa46
Aug 17 21:10:49 user nova-compute[72818]: INFO nova.virt.node [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Wrote node identity d156e3af-684d-47e1-a951-585f9c95fa46 to /opt/stack/data/nova/compute_id
Aug 17 21:10:49 user nova-compute[72818]: WARNING nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Compute nodes ['d156e3af-684d-47e1-a951-585f9c95fa46'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 17 21:10:49 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 17 21:10:50 user nova-compute[72818]: WARNING nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 21:10:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:10:50 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:10:50 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Hypervisor/Node resource view: name=user free_ram=10857MB free_disk=26.326251983642578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:10:50 user nova-compute[72818]: WARNING nova.compute.resource_tracker [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] No compute node record for user:d156e3af-684d-47e1-a951-585f9c95fa46: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d156e3af-684d-47e1-a951-585f9c95fa46 could not be found.
Aug 17 21:10:50 user nova-compute[72818]: INFO nova.compute.resource_tracker [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Compute node record created for user:user with uuid: d156e3af-684d-47e1-a951-585f9c95fa46
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:10:50 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [req-7d47bfb2-9ac1-4450-8df0-da514227fed4] Created resource provider record via placement API for resource provider with UUID d156e3af-684d-47e1-a951-585f9c95fa46 and name user.
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72818) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 17 21:10:50 user nova-compute[72818]: INFO nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] kernel doesn't support AMD SEV
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Libvirt baseline CPU <cpu>
Aug 17 21:10:50 user nova-compute[72818]:   <arch>x86_64</arch>
Aug 17 21:10:50 user nova-compute[72818]:   <model>Nehalem</model>
Aug 17 21:10:50 user nova-compute[72818]:   <vendor>Intel</vendor>
Aug 17 21:10:50 user nova-compute[72818]:   <topology sockets="6" cores="1" threads="1"/>
Aug 17 21:10:50 user nova-compute[72818]: </cpu>
Aug 17 21:10:50 user nova-compute[72818]:  {{(pid=72818) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Updated inventory for provider d156e3af-684d-47e1-a951-585f9c95fa46 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Updating resource provider d156e3af-684d-47e1-a951-585f9c95fa46 generation from 0 to 1 during operation: update_inventory {{(pid=72818) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Updating resource provider d156e3af-684d-47e1-a951-585f9c95fa46 generation from 1 to 2 during operation: update_traits {{(pid=72818) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.675s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:10:50 user nova-compute[72818]: DEBUG nova.service [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Creating RPC server for service compute {{(pid=72818) start /opt/stack/nova/nova/service.py:182}}
Aug 17 21:10:51 user nova-compute[72818]: DEBUG nova.service [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Join ServiceGroup membership for this service compute {{(pid=72818) start /opt/stack/nova/nova/service.py:199}}
Aug 17 21:10:51 user nova-compute[72818]: DEBUG nova.servicegroup.drivers.db [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72818) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 17 21:11:37 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:11:37 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:11:41 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:11:42 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:11:42 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:11:42 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=10272MB free_disk=26.229976654052734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:11:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:11:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:11:42 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:11:42 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:11:42 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:11:42 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:11:42 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:11:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:12:42 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:12:43 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:12:43 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:12:43 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=10205MB free_disk=26.276016235351562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:12:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:12:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:12:43 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:12:43 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:12:43 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:12:43 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:12:43 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:12:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:12:44 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:12:44 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:12:44 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:12:44 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:13:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:13:42 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:13:43 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:13:43 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:13:44 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:13:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:13:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:13:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 21:13:44 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:13:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:13:44 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:13:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:13:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:13:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:13:44 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:13:45 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:13:45 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:13:45 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=10160MB free_disk=26.060138702392578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:13:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:13:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:13:45 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:13:45 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:13:45 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:13:45 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:13:45 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:13:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:13:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:13:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:14:42 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:14:43 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:14:43 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:14:44 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:14:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:14:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:14:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 21:14:44 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:14:45 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:14:45 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:14:45 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:14:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:14:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:14:46 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:14:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:14:46 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "b9a0da7f-47b4-467f-944d-49adac671a06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "b9a0da7f-47b4-467f-944d-49adac671a06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:47 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:14:47 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:14:47 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=9386MB free_disk=26.08205795288086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 32d5ecaa-f8b2-4181-9171-f0d78493ffb2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.434s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:47 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:14:47 user nova-compute[72818]: INFO nova.compute.claims [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Claim successful on node user
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.660s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:14:48 user nova-compute[72818]: INFO nova.compute.claims [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Claim successful on node user
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:14:48 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:14:48 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Creating image(s)
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "/opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "/opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "/opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.policy [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8f74b1cdf584477a52b270e474f7b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba6109d7274198ba4db4769b64a372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.network.neutron [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:14:48 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:14:48 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Creating image(s)
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "/opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "/opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:14:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35.part --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:49 user nova-compute[72818]: DEBUG nova.policy [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6cd1f219a2634975bb1362620392dc1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0b81a8a39436a9ec6e1646090f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:14:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35.part --force-share --output=json" returned: 0 in 0.190s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:49 user nova-compute[72818]: DEBUG nova.virt.images [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] 18340577-52dd-4d73-ae6b-8ba3ed9c0808 was qcow2, converting to raw {{(pid=72818) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 21:14:49 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:14:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35.part /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35.converted {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35.part /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35.converted" returned: 0 in 0.151s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35.converted --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:49 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Successfully created port: 4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:14:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.612s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:14:50 user nova-compute[72818]: INFO oslo.privsep.daemon [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4wqt5xa0/privsep.sock']
Aug 17 21:14:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.274s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:14:50 user sudo[82040]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4wqt5xa0/privsep.sock
Aug 17 21:14:50 user sudo[82040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 21:14:51 user sudo[82040]: pam_unix(sudo:session): session closed for user root
Aug 17 21:14:51 user nova-compute[72818]: INFO oslo.privsep.daemon [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Spawned new privsep daemon via rootwrap
Aug 17 21:14:51 user nova-compute[72818]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 21:14:51 user nova-compute[72818]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 21:14:51 user nova-compute[72818]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 17 21:14:51 user nova-compute[72818]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82044
Aug 17 21:14:51 user nova-compute[72818]: WARNING oslo_privsep.priv_context [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] privsep daemon already running
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.168s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.234s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.218s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk 1073741824" returned: 0 in 0.169s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.391s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Successfully created port: 46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.427s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.208s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.201s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk 1073741824" returned: 0 in 0.056s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Cannot resize image /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lazy-loading 'migration_context' on Instance uuid 32d5ecaa-f8b2-4181-9171-f0d78493ffb2 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Ensure instance console log exists: /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.202s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Cannot resize image /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG nova.objects.instance [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'migration_context' on Instance uuid b9a0da7f-47b4-467f-944d-49adac671a06 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Ensure instance console log exists: /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:14:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:14:54 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Successfully updated port: 4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:14:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "refresh_cache-32d5ecaa-f8b2-4181-9171-f0d78493ffb2" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:14:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquired lock "refresh_cache-32d5ecaa-f8b2-4181-9171-f0d78493ffb2" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:14:54 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:14:54 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:14:54 user nova-compute[72818]: DEBUG nova.compute.manager [req-5ee15a37-9bcf-43bd-841e-7709d3716a5e req-73bfefed-3a31-46e0-8579-24b67daa909b service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Received event network-changed-4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:14:54 user nova-compute[72818]: DEBUG nova.compute.manager [req-5ee15a37-9bcf-43bd-841e-7709d3716a5e req-73bfefed-3a31-46e0-8579-24b67daa909b service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Refreshing instance network info cache due to event network-changed-4f9c960f-9da7-45e6-8244-3b3b5f205912. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:14:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5ee15a37-9bcf-43bd-841e-7709d3716a5e req-73bfefed-3a31-46e0-8579-24b67daa909b service nova] Acquiring lock "refresh_cache-32d5ecaa-f8b2-4181-9171-f0d78493ffb2" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Updating instance_info_cache with network_info: [{"id": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "address": "fa:16:3e:30:65:83", "network": {"id": "cf8d1111-fc56-453b-87fe-698e5d537fed", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1309064060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eba6109d7274198ba4db4769b64a372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9c960f-9d", "ovs_interfaceid": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Releasing lock "refresh_cache-32d5ecaa-f8b2-4181-9171-f0d78493ffb2" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Instance network_info: |[{"id": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "address": "fa:16:3e:30:65:83", "network": {"id": "cf8d1111-fc56-453b-87fe-698e5d537fed", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1309064060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eba6109d7274198ba4db4769b64a372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9c960f-9d", "ovs_interfaceid": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5ee15a37-9bcf-43bd-841e-7709d3716a5e req-73bfefed-3a31-46e0-8579-24b67daa909b service nova] Acquired lock "refresh_cache-32d5ecaa-f8b2-4181-9171-f0d78493ffb2" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.network.neutron [req-5ee15a37-9bcf-43bd-841e-7709d3716a5e req-73bfefed-3a31-46e0-8579-24b67daa909b service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Refreshing network info cache for port 4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Start _get_guest_xml network_info=[{"id": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "address": "fa:16:3e:30:65:83", "network": {"id": "cf8d1111-fc56-453b-87fe-698e5d537fed", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1309064060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eba6109d7274198ba4db4769b64a372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9c960f-9d", "ovs_interfaceid": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:14:55 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:14:55 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1005601673',display_name='tempest-DeleteServersTestJSON-server-1005601673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1005601673',id=1,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eba6109d7274198ba4db4769b64a372',ramdisk_id='',reservation_id='r-i2n2vjm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-724394875',owner_user_name='tempest-DeleteServersTestJSON-724394875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:14:48Z,user_data=None,user_id='c8f74b1cdf584477a52b270e474f7b4c',uuid=32d5ecaa-f8b2-4181-9171-f0d78493ffb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "address": "fa:16:3e:30:65:83", "network": {"id": "cf8d1111-fc56-453b-87fe-698e5d537fed", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1309064060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eba6109d7274198ba4db4769b64a372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9c960f-9d", "ovs_interfaceid": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Converting VIF {"id": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "address": "fa:16:3e:30:65:83", "network": {"id": "cf8d1111-fc56-453b-87fe-698e5d537fed", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1309064060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eba6109d7274198ba4db4769b64a372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9c960f-9d", "ovs_interfaceid": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:65:83,bridge_name='br-int',has_traffic_filtering=True,id=4f9c960f-9da7-45e6-8244-3b3b5f205912,network=Network(cf8d1111-fc56-453b-87fe-698e5d537fed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9c960f-9d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lazy-loading 'pci_devices' on Instance uuid 32d5ecaa-f8b2-4181-9171-f0d78493ffb2 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:14:55 user nova-compute[72818]:   <uuid>32d5ecaa-f8b2-4181-9171-f0d78493ffb2</uuid>
Aug 17 21:14:55 user nova-compute[72818]:   <name>instance-00000001</name>
Aug 17 21:14:55 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:14:55 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:14:55 user nova-compute[72818]:   <metadata>
Aug 17 21:14:55 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:14:55 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:14:55 user nova-compute[72818]:       <nova:name>tempest-DeleteServersTestJSON-server-1005601673</nova:name>
Aug 17 21:14:55 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:14:55</nova:creationTime>
Aug 17 21:14:55 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:14:55 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:14:55 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:14:55 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:14:55 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:14:55 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:14:55 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:14:55 user nova-compute[72818]:       <nova:owner>
Aug 17 21:14:55 user nova-compute[72818]:         <nova:user uuid="c8f74b1cdf584477a52b270e474f7b4c">tempest-DeleteServersTestJSON-724394875-project-member</nova:user>
Aug 17 21:14:55 user nova-compute[72818]:         <nova:project uuid="8eba6109d7274198ba4db4769b64a372">tempest-DeleteServersTestJSON-724394875</nova:project>
Aug 17 21:14:55 user nova-compute[72818]:       </nova:owner>
Aug 17 21:14:55 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:14:55 user nova-compute[72818]:       <nova:ports>
Aug 17 21:14:55 user nova-compute[72818]:         <nova:port uuid="4f9c960f-9da7-45e6-8244-3b3b5f205912">
Aug 17 21:14:55 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 21:14:55 user nova-compute[72818]:         </nova:port>
Aug 17 21:14:55 user nova-compute[72818]:       </nova:ports>
Aug 17 21:14:55 user nova-compute[72818]:     </nova:instance>
Aug 17 21:14:55 user nova-compute[72818]:   </metadata>
Aug 17 21:14:55 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:14:55 user nova-compute[72818]:     <system>
Aug 17 21:14:55 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:14:55 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:14:55 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:14:55 user nova-compute[72818]:       <entry name="serial">32d5ecaa-f8b2-4181-9171-f0d78493ffb2</entry>
Aug 17 21:14:55 user nova-compute[72818]:       <entry name="uuid">32d5ecaa-f8b2-4181-9171-f0d78493ffb2</entry>
Aug 17 21:14:55 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:14:55 user nova-compute[72818]:     </system>
Aug 17 21:14:55 user nova-compute[72818]:   </sysinfo>
Aug 17 21:14:55 user nova-compute[72818]:   <os>
Aug 17 21:14:55 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:14:55 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:14:55 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:14:55 user nova-compute[72818]:   </os>
Aug 17 21:14:55 user nova-compute[72818]:   <features>
Aug 17 21:14:55 user nova-compute[72818]:     <acpi/>
Aug 17 21:14:55 user nova-compute[72818]:     <apic/>
Aug 17 21:14:55 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:14:55 user nova-compute[72818]:   </features>
Aug 17 21:14:55 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:14:55 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:14:55 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:14:55 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:14:55 user nova-compute[72818]:   </clock>
Aug 17 21:14:55 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:14:55 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:14:55 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:14:55 user nova-compute[72818]:   </cpu>
Aug 17 21:14:55 user nova-compute[72818]:   <devices>
Aug 17 21:14:55 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:14:55 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:14:55 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk"/>
Aug 17 21:14:55 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:14:55 user nova-compute[72818]:     </disk>
Aug 17 21:14:55 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:14:55 user nova-compute[72818]:       <mac address="fa:16:3e:30:65:83"/>
Aug 17 21:14:55 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:14:55 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:14:55 user nova-compute[72818]:       <target dev="tap4f9c960f-9d"/>
Aug 17 21:14:55 user nova-compute[72818]:     </interface>
Aug 17 21:14:55 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:14:55 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/console.log" append="off"/>
Aug 17 21:14:55 user nova-compute[72818]:     </serial>
Aug 17 21:14:55 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:14:55 user nova-compute[72818]:     <video>
Aug 17 21:14:55 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:14:55 user nova-compute[72818]:     </video>
Aug 17 21:14:55 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:14:55 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:14:55 user nova-compute[72818]:     </rng>
Aug 17 21:14:55 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:14:55 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:14:55 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:14:55 user nova-compute[72818]:     </memballoon>
Aug 17 21:14:55 user nova-compute[72818]:   </devices>
Aug 17 21:14:55 user nova-compute[72818]: </domain>
Aug 17 21:14:55 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1005601673',display_name='tempest-DeleteServersTestJSON-server-1005601673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1005601673',id=1,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eba6109d7274198ba4db4769b64a372',ramdisk_id='',reservation_id='r-i2n2vjm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-724394875',owner_user_name='tempest-DeleteServersTestJSON-724394875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:14:48Z,user_data=None,user_id='c8f74b1cdf584477a52b270e474f7b4c',uuid=32d5ecaa-f8b2-4181-9171-f0d78493ffb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "address": "fa:16:3e:30:65:83", "network": {"id": "cf8d1111-fc56-453b-87fe-698e5d537fed", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1309064060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eba6109d7274198ba4db4769b64a372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9c960f-9d", "ovs_interfaceid": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Converting VIF {"id": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "address": "fa:16:3e:30:65:83", "network": {"id": "cf8d1111-fc56-453b-87fe-698e5d537fed", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1309064060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eba6109d7274198ba4db4769b64a372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9c960f-9d", "ovs_interfaceid": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:65:83,bridge_name='br-int',has_traffic_filtering=True,id=4f9c960f-9da7-45e6-8244-3b3b5f205912,network=Network(cf8d1111-fc56-453b-87fe-698e5d537fed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9c960f-9d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG os_vif [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:65:83,bridge_name='br-int',has_traffic_filtering=True,id=4f9c960f-9da7-45e6-8244-3b3b5f205912,network=Network(cf8d1111-fc56-453b-87fe-698e5d537fed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9c960f-9d') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:14:55 user nova-compute[72818]: DEBUG nova.network.neutron [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Successfully updated port: 46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Created schema index Interface.name {{(pid=72818) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Created schema index Port.name {{(pid=72818) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Created schema index Bridge.name {{(pid=72818) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquired lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG nova.network.neutron [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [POLLOUT] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:14:56 user nova-compute[72818]: INFO oslo.privsep.daemon [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmprtv31059/privsep.sock']
Aug 17 21:14:56 user sudo[82079]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmprtv31059/privsep.sock
Aug 17 21:14:56 user sudo[82079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 21:14:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-6a878508-f80a-45f8-ace3-b80c11e058eb req-3dd5ff57-1471-4658-8835-a09e4679a12e service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Received event network-changed-46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-6a878508-f80a-45f8-ace3-b80c11e058eb req-3dd5ff57-1471-4658-8835-a09e4679a12e service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Refreshing instance network info cache due to event network-changed-46d37cbb-49e1-4c67-b399-8a1008e611ff. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6a878508-f80a-45f8-ace3-b80c11e058eb req-3dd5ff57-1471-4658-8835-a09e4679a12e service nova] Acquiring lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:14:56 user nova-compute[72818]: DEBUG nova.network.neutron [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.network.neutron [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Updating instance_info_cache with network_info: [{"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Releasing lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Instance network_info: |[{"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6a878508-f80a-45f8-ace3-b80c11e058eb req-3dd5ff57-1471-4658-8835-a09e4679a12e service nova] Acquired lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.network.neutron [req-6a878508-f80a-45f8-ace3-b80c11e058eb req-3dd5ff57-1471-4658-8835-a09e4679a12e service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Refreshing network info cache for port 46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Start _get_guest_xml network_info=[{"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:14:57 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:14:57 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1562943068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1562943068',id=2,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-kkbximac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:14:49Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=b9a0da7f-47b4-467f-944d-49adac671a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=46d37cbb-49e1-4c67-b399-8a1008e611ff,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d37cbb-49') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.objects.instance [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'pci_devices' on Instance uuid b9a0da7f-47b4-467f-944d-49adac671a06 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:14:57 user nova-compute[72818]:   <uuid>b9a0da7f-47b4-467f-944d-49adac671a06</uuid>
Aug 17 21:14:57 user nova-compute[72818]:   <name>instance-00000002</name>
Aug 17 21:14:57 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:14:57 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:14:57 user nova-compute[72818]:   <metadata>
Aug 17 21:14:57 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:14:57 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:14:57 user nova-compute[72818]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1562943068</nova:name>
Aug 17 21:14:57 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:14:57</nova:creationTime>
Aug 17 21:14:57 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:14:57 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:14:57 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:14:57 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:14:57 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:14:57 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:14:57 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:14:57 user nova-compute[72818]:       <nova:owner>
Aug 17 21:14:57 user nova-compute[72818]:         <nova:user uuid="6cd1f219a2634975bb1362620392dc1a">tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member</nova:user>
Aug 17 21:14:57 user nova-compute[72818]:         <nova:project uuid="dda0b81a8a39436a9ec6e1646090f637">tempest-ServerBootFromVolumeStableRescueTest-1074783662</nova:project>
Aug 17 21:14:57 user nova-compute[72818]:       </nova:owner>
Aug 17 21:14:57 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:14:57 user nova-compute[72818]:       <nova:ports>
Aug 17 21:14:57 user nova-compute[72818]:         <nova:port uuid="46d37cbb-49e1-4c67-b399-8a1008e611ff">
Aug 17 21:14:57 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 21:14:57 user nova-compute[72818]:         </nova:port>
Aug 17 21:14:57 user nova-compute[72818]:       </nova:ports>
Aug 17 21:14:57 user nova-compute[72818]:     </nova:instance>
Aug 17 21:14:57 user nova-compute[72818]:   </metadata>
Aug 17 21:14:57 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:14:57 user nova-compute[72818]:     <system>
Aug 17 21:14:57 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:14:57 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:14:57 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:14:57 user nova-compute[72818]:       <entry name="serial">b9a0da7f-47b4-467f-944d-49adac671a06</entry>
Aug 17 21:14:57 user nova-compute[72818]:       <entry name="uuid">b9a0da7f-47b4-467f-944d-49adac671a06</entry>
Aug 17 21:14:57 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:14:57 user nova-compute[72818]:     </system>
Aug 17 21:14:57 user nova-compute[72818]:   </sysinfo>
Aug 17 21:14:57 user nova-compute[72818]:   <os>
Aug 17 21:14:57 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:14:57 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:14:57 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:14:57 user nova-compute[72818]:   </os>
Aug 17 21:14:57 user nova-compute[72818]:   <features>
Aug 17 21:14:57 user nova-compute[72818]:     <acpi/>
Aug 17 21:14:57 user nova-compute[72818]:     <apic/>
Aug 17 21:14:57 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:14:57 user nova-compute[72818]:   </features>
Aug 17 21:14:57 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:14:57 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:14:57 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:14:57 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:14:57 user nova-compute[72818]:   </clock>
Aug 17 21:14:57 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:14:57 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:14:57 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:14:57 user nova-compute[72818]:   </cpu>
Aug 17 21:14:57 user nova-compute[72818]:   <devices>
Aug 17 21:14:57 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:14:57 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:14:57 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk"/>
Aug 17 21:14:57 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:14:57 user nova-compute[72818]:     </disk>
Aug 17 21:14:57 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:14:57 user nova-compute[72818]:       <mac address="fa:16:3e:51:68:9d"/>
Aug 17 21:14:57 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:14:57 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:14:57 user nova-compute[72818]:       <target dev="tap46d37cbb-49"/>
Aug 17 21:14:57 user nova-compute[72818]:     </interface>
Aug 17 21:14:57 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:14:57 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/console.log" append="off"/>
Aug 17 21:14:57 user nova-compute[72818]:     </serial>
Aug 17 21:14:57 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:14:57 user nova-compute[72818]:     <video>
Aug 17 21:14:57 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:14:57 user nova-compute[72818]:     </video>
Aug 17 21:14:57 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:14:57 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:14:57 user nova-compute[72818]:     </rng>
Aug 17 21:14:57 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:14:57 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:14:57 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:14:57 user nova-compute[72818]:     </memballoon>
Aug 17 21:14:57 user nova-compute[72818]:   </devices>
Aug 17 21:14:57 user nova-compute[72818]: </domain>
Aug 17 21:14:57 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1562943068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1562943068',id=2,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-kkbximac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:14:49Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=b9a0da7f-47b4-467f-944d-49adac671a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=46d37cbb-49e1-4c67-b399-8a1008e611ff,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d37cbb-49') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG os_vif [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=46d37cbb-49e1-4c67-b399-8a1008e611ff,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d37cbb-49') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.network.neutron [req-5ee15a37-9bcf-43bd-841e-7709d3716a5e req-73bfefed-3a31-46e0-8579-24b67daa909b service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Updated VIF entry in instance network info cache for port 4f9c960f-9da7-45e6-8244-3b3b5f205912. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG nova.network.neutron [req-5ee15a37-9bcf-43bd-841e-7709d3716a5e req-73bfefed-3a31-46e0-8579-24b67daa909b service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Updating instance_info_cache with network_info: [{"id": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "address": "fa:16:3e:30:65:83", "network": {"id": "cf8d1111-fc56-453b-87fe-698e5d537fed", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1309064060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eba6109d7274198ba4db4769b64a372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9c960f-9d", "ovs_interfaceid": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:14:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5ee15a37-9bcf-43bd-841e-7709d3716a5e req-73bfefed-3a31-46e0-8579-24b67daa909b service nova] Releasing lock "refresh_cache-32d5ecaa-f8b2-4181-9171-f0d78493ffb2" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:14:58 user sudo[82079]: pam_unix(sudo:session): session closed for user root
Aug 17 21:14:58 user nova-compute[72818]: INFO oslo.privsep.daemon [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Spawned new privsep daemon via rootwrap
Aug 17 21:14:58 user nova-compute[72818]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 21:14:58 user nova-compute[72818]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 21:14:58 user nova-compute[72818]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 17 21:14:58 user nova-compute[72818]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82137
Aug 17 21:14:58 user nova-compute[72818]: WARNING oslo_privsep.priv_context [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] privsep daemon already running
Aug 17 21:14:58 user nova-compute[72818]: DEBUG nova.network.neutron [req-6a878508-f80a-45f8-ace3-b80c11e058eb req-3dd5ff57-1471-4658-8835-a09e4679a12e service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Updated VIF entry in instance network info cache for port 46d37cbb-49e1-4c67-b399-8a1008e611ff. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG nova.network.neutron [req-6a878508-f80a-45f8-ace3-b80c11e058eb req-3dd5ff57-1471-4658-8835-a09e4679a12e service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Updating instance_info_cache with network_info: [{"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6a878508-f80a-45f8-ace3-b80c11e058eb req-3dd5ff57-1471-4658-8835-a09e4679a12e service nova] Releasing lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46d37cbb-49, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46d37cbb-49, col_values=(('external_ids', {'iface-id': '46d37cbb-49e1-4c67-b399-8a1008e611ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:68:9d', 'vm-uuid': 'b9a0da7f-47b4-467f-944d-49adac671a06'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:14:58 user nova-compute[72818]: INFO os_vif [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=46d37cbb-49e1-4c67-b399-8a1008e611ff,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d37cbb-49')
Aug 17 21:14:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f9c960f-9d, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f9c960f-9d, col_values=(('external_ids', {'iface-id': '4f9c960f-9da7-45e6-8244-3b3b5f205912', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:65:83', 'vm-uuid': '32d5ecaa-f8b2-4181-9171-f0d78493ffb2'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:14:58 user nova-compute[72818]: INFO os_vif [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:65:83,bridge_name='br-int',has_traffic_filtering=True,id=4f9c960f-9da7-45e6-8244-3b3b5f205912,network=Network(cf8d1111-fc56-453b-87fe-698e5d537fed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9c960f-9d')
Aug 17 21:14:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No VIF found with MAC fa:16:3e:51:68:9d, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:14:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] No VIF found with MAC fa:16:3e:30:65:83, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:15:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-93deff69-5e9e-4342-95f7-1435076df8de req-004520a2-9bef-4e8d-9663-ccd16d87f2c3 service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Received event network-vif-plugged-46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-93deff69-5e9e-4342-95f7-1435076df8de req-004520a2-9bef-4e8d-9663-ccd16d87f2c3 service nova] Acquiring lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-93deff69-5e9e-4342-95f7-1435076df8de req-004520a2-9bef-4e8d-9663-ccd16d87f2c3 service nova] Lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-93deff69-5e9e-4342-95f7-1435076df8de req-004520a2-9bef-4e8d-9663-ccd16d87f2c3 service nova] Lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-93deff69-5e9e-4342-95f7-1435076df8de req-004520a2-9bef-4e8d-9663-ccd16d87f2c3 service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] No waiting events found dispatching network-vif-plugged-46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:02 user nova-compute[72818]: WARNING nova.compute.manager [req-93deff69-5e9e-4342-95f7-1435076df8de req-004520a2-9bef-4e8d-9663-ccd16d87f2c3 service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Received unexpected event network-vif-plugged-46d37cbb-49e1-4c67-b399-8a1008e611ff for instance with vm_state building and task_state spawning.
Aug 17 21:15:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306903.4301732, 32d5ecaa-f8b2-4181-9171-f0d78493ffb2 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:03 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] VM Resumed (Lifecycle Event)
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:15:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Instance spawned successfully.
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:15:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Instance spawned successfully.
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:03 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306903.4475207, b9a0da7f-47b4-467f-944d-49adac671a06 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:03 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] VM Resumed (Lifecycle Event)
Aug 17 21:15:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:03 user nova-compute[72818]: INFO nova.compute.manager [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Took 15.21 seconds to spawn the instance on the hypervisor.
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:03 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306903.4476068, 32d5ecaa-f8b2-4181-9171-f0d78493ffb2 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:03 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] VM Started (Lifecycle Event)
Aug 17 21:15:03 user nova-compute[72818]: INFO nova.compute.manager [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Took 14.95 seconds to spawn the instance on the hypervisor.
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:03 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306903.4476883, b9a0da7f-47b4-467f-944d-49adac671a06 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:03 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] VM Started (Lifecycle Event)
Aug 17 21:15:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:04 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:15:04 user nova-compute[72818]: INFO nova.compute.manager [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Took 16.71 seconds to build instance.
Aug 17 21:15:04 user nova-compute[72818]: INFO nova.compute.manager [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Took 16.64 seconds to build instance.
Aug 17 21:15:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fcc51b8e-b375-46c6-b4f3-e3cf15fc35d8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "b9a0da7f-47b4-467f-944d-49adac671a06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.752s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f434242c-9059-44df-95fa-6f5fd8d0bb64 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.386s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-a28ecbb5-6909-4bbd-ae13-9e731ee8b2c2 req-3264e6ce-6d20-4c2b-a156-e5f3cf6519bd service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Received event network-vif-plugged-46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a28ecbb5-6909-4bbd-ae13-9e731ee8b2c2 req-3264e6ce-6d20-4c2b-a156-e5f3cf6519bd service nova] Acquiring lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a28ecbb5-6909-4bbd-ae13-9e731ee8b2c2 req-3264e6ce-6d20-4c2b-a156-e5f3cf6519bd service nova] Lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a28ecbb5-6909-4bbd-ae13-9e731ee8b2c2 req-3264e6ce-6d20-4c2b-a156-e5f3cf6519bd service nova] Lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-a28ecbb5-6909-4bbd-ae13-9e731ee8b2c2 req-3264e6ce-6d20-4c2b-a156-e5f3cf6519bd service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] No waiting events found dispatching network-vif-plugged-46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:04 user nova-compute[72818]: WARNING nova.compute.manager [req-a28ecbb5-6909-4bbd-ae13-9e731ee8b2c2 req-3264e6ce-6d20-4c2b-a156-e5f3cf6519bd service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Received unexpected event network-vif-plugged-46d37cbb-49e1-4c67-b399-8a1008e611ff for instance with vm_state active and task_state None.
Aug 17 21:15:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:18 user nova-compute[72818]: DEBUG nova.compute.manager [req-048fb269-9d91-44f3-819b-7782d456f853 req-adc25478-27cc-43b7-b6a0-767c13b030f9 service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Received event network-vif-plugged-4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-048fb269-9d91-44f3-819b-7782d456f853 req-adc25478-27cc-43b7-b6a0-767c13b030f9 service nova] Acquiring lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-048fb269-9d91-44f3-819b-7782d456f853 req-adc25478-27cc-43b7-b6a0-767c13b030f9 service nova] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-048fb269-9d91-44f3-819b-7782d456f853 req-adc25478-27cc-43b7-b6a0-767c13b030f9 service nova] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:18 user nova-compute[72818]: DEBUG nova.compute.manager [req-048fb269-9d91-44f3-819b-7782d456f853 req-adc25478-27cc-43b7-b6a0-767c13b030f9 service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] No waiting events found dispatching network-vif-plugged-4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:18 user nova-compute[72818]: WARNING nova.compute.manager [req-048fb269-9d91-44f3-819b-7782d456f853 req-adc25478-27cc-43b7-b6a0-767c13b030f9 service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Received unexpected event network-vif-plugged-4f9c960f-9da7-45e6-8244-3b3b5f205912 for instance with vm_state active and task_state None.
Aug 17 21:15:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-6786c24a-f986-4129-a5d6-c0295a7ed78d req-e5c2dd9f-7119-419c-b034-2d4ac08437c1 service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Received event network-vif-plugged-4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6786c24a-f986-4129-a5d6-c0295a7ed78d req-e5c2dd9f-7119-419c-b034-2d4ac08437c1 service nova] Acquiring lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6786c24a-f986-4129-a5d6-c0295a7ed78d req-e5c2dd9f-7119-419c-b034-2d4ac08437c1 service nova] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6786c24a-f986-4129-a5d6-c0295a7ed78d req-e5c2dd9f-7119-419c-b034-2d4ac08437c1 service nova] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-6786c24a-f986-4129-a5d6-c0295a7ed78d req-e5c2dd9f-7119-419c-b034-2d4ac08437c1 service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] No waiting events found dispatching network-vif-plugged-4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:20 user nova-compute[72818]: WARNING nova.compute.manager [req-6786c24a-f986-4129-a5d6-c0295a7ed78d req-e5c2dd9f-7119-419c-b034-2d4ac08437c1 service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Received unexpected event network-vif-plugged-4f9c960f-9da7-45e6-8244-3b3b5f205912 for instance with vm_state active and task_state None.
Aug 17 21:15:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:15:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:23 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:15:23 user nova-compute[72818]: INFO nova.compute.claims [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Claim successful on node user
Aug 17 21:15:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:23 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:15:23 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:15:24 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:15:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:15:24 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Creating image(s)
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "/opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "/opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "/opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG nova.policy [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a882239cd3054ad3abc93fd0b32a70c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f25ddb77be74b0184e1685cd0e34122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.229s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.208s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk 1073741824" returned: 0 in 0.057s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.206s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:25 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:15:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:25 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Cannot resize image /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:15:25 user nova-compute[72818]: DEBUG nova.objects.instance [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lazy-loading 'migration_context' on Instance uuid b93c6b2f-59ee-4e7f-9805-97ef627eccdb {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:15:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:15:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Ensure instance console log exists: /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:15:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Successfully created port: e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Successfully updated port: e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "refresh_cache-b93c6b2f-59ee-4e7f-9805-97ef627eccdb" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquired lock "refresh_cache-b93c6b2f-59ee-4e7f-9805-97ef627eccdb" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.compute.manager [req-0c4210ef-c651-46ff-bf06-5d411e647748 req-b77fc4b0-3a71-41a6-9176-51129a047acb service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Received event network-changed-e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.compute.manager [req-0c4210ef-c651-46ff-bf06-5d411e647748 req-b77fc4b0-3a71-41a6-9176-51129a047acb service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Refreshing instance network info cache due to event network-changed-e94f410f-1593-4c05-ae40-a8c34f12c210. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0c4210ef-c651-46ff-bf06-5d411e647748 req-b77fc4b0-3a71-41a6-9176-51129a047acb service nova] Acquiring lock "refresh_cache-b93c6b2f-59ee-4e7f-9805-97ef627eccdb" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "796d2c15-1728-4cd2-a325-e9385556050f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:15:27 user nova-compute[72818]: INFO nova.compute.claims [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Claim successful on node user
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Updating instance_info_cache with network_info: [{"id": "e94f410f-1593-4c05-ae40-a8c34f12c210", "address": "fa:16:3e:69:af:13", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94f410f-15", "ovs_interfaceid": "e94f410f-1593-4c05-ae40-a8c34f12c210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Releasing lock "refresh_cache-b93c6b2f-59ee-4e7f-9805-97ef627eccdb" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Instance network_info: |[{"id": "e94f410f-1593-4c05-ae40-a8c34f12c210", "address": "fa:16:3e:69:af:13", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94f410f-15", "ovs_interfaceid": "e94f410f-1593-4c05-ae40-a8c34f12c210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0c4210ef-c651-46ff-bf06-5d411e647748 req-b77fc4b0-3a71-41a6-9176-51129a047acb service nova] Acquired lock "refresh_cache-b93c6b2f-59ee-4e7f-9805-97ef627eccdb" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-0c4210ef-c651-46ff-bf06-5d411e647748 req-b77fc4b0-3a71-41a6-9176-51129a047acb service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Refreshing network info cache for port e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Start _get_guest_xml network_info=[{"id": "e94f410f-1593-4c05-ae40-a8c34f12c210", "address": "fa:16:3e:69:af:13", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94f410f-15", "ovs_interfaceid": "e94f410f-1593-4c05-ae40-a8c34f12c210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:15:27 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:15:27 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1281543925',display_name='tempest-VolumesAdminNegativeTest-server-1281543925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1281543925',id=3,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtFclPFjSP/42/RDUl6TDrox7+s9GiwKes/5lRbYQGq2xerW1PvPXcvnWfT+eHcrWbRmThiUKcPp+BSugRt8X4G8isgmYwFEKZpmUenXJPnsI1hD9NjvgXCQaM/DKoIQQ==',key_name='tempest-keypair-1123154090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f25ddb77be74b0184e1685cd0e34122',ramdisk_id='',reservation_id='r-yxru26xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-342058843',owner_user_name='tempest-VolumesAdminNegativeTest-342058843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a882239cd3054ad3abc93fd0b32a70c7',uuid=b93c6b2f-59ee-4e7f-9805-97ef627eccdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e94f410f-1593-4c05-ae40-a8c34f12c210", "address": "fa:16:3e:69:af:13", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94f410f-15", "ovs_interfaceid": "e94f410f-1593-4c05-ae40-a8c34f12c210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Converting VIF {"id": "e94f410f-1593-4c05-ae40-a8c34f12c210", "address": "fa:16:3e:69:af:13", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94f410f-15", "ovs_interfaceid": "e94f410f-1593-4c05-ae40-a8c34f12c210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:af:13,bridge_name='br-int',has_traffic_filtering=True,id=e94f410f-1593-4c05-ae40-a8c34f12c210,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94f410f-15') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.objects.instance [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lazy-loading 'pci_devices' on Instance uuid b93c6b2f-59ee-4e7f-9805-97ef627eccdb {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:15:27 user nova-compute[72818]:   <uuid>b93c6b2f-59ee-4e7f-9805-97ef627eccdb</uuid>
Aug 17 21:15:27 user nova-compute[72818]:   <name>instance-00000003</name>
Aug 17 21:15:27 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:15:27 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:15:27 user nova-compute[72818]:   <metadata>
Aug 17 21:15:27 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:15:27 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:15:27 user nova-compute[72818]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1281543925</nova:name>
Aug 17 21:15:27 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:15:27</nova:creationTime>
Aug 17 21:15:27 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:15:27 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:15:27 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:15:27 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:15:27 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:15:27 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:15:27 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:15:27 user nova-compute[72818]:       <nova:owner>
Aug 17 21:15:27 user nova-compute[72818]:         <nova:user uuid="a882239cd3054ad3abc93fd0b32a70c7">tempest-VolumesAdminNegativeTest-342058843-project-member</nova:user>
Aug 17 21:15:27 user nova-compute[72818]:         <nova:project uuid="0f25ddb77be74b0184e1685cd0e34122">tempest-VolumesAdminNegativeTest-342058843</nova:project>
Aug 17 21:15:27 user nova-compute[72818]:       </nova:owner>
Aug 17 21:15:27 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:15:27 user nova-compute[72818]:       <nova:ports>
Aug 17 21:15:27 user nova-compute[72818]:         <nova:port uuid="e94f410f-1593-4c05-ae40-a8c34f12c210">
Aug 17 21:15:27 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 21:15:27 user nova-compute[72818]:         </nova:port>
Aug 17 21:15:27 user nova-compute[72818]:       </nova:ports>
Aug 17 21:15:27 user nova-compute[72818]:     </nova:instance>
Aug 17 21:15:27 user nova-compute[72818]:   </metadata>
Aug 17 21:15:27 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:15:27 user nova-compute[72818]:     <system>
Aug 17 21:15:27 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:15:27 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:15:27 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:15:27 user nova-compute[72818]:       <entry name="serial">b93c6b2f-59ee-4e7f-9805-97ef627eccdb</entry>
Aug 17 21:15:27 user nova-compute[72818]:       <entry name="uuid">b93c6b2f-59ee-4e7f-9805-97ef627eccdb</entry>
Aug 17 21:15:27 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:15:27 user nova-compute[72818]:     </system>
Aug 17 21:15:27 user nova-compute[72818]:   </sysinfo>
Aug 17 21:15:27 user nova-compute[72818]:   <os>
Aug 17 21:15:27 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:15:27 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:15:27 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:15:27 user nova-compute[72818]:   </os>
Aug 17 21:15:27 user nova-compute[72818]:   <features>
Aug 17 21:15:27 user nova-compute[72818]:     <acpi/>
Aug 17 21:15:27 user nova-compute[72818]:     <apic/>
Aug 17 21:15:27 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:15:27 user nova-compute[72818]:   </features>
Aug 17 21:15:27 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:15:27 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:15:27 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:15:27 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:15:27 user nova-compute[72818]:   </clock>
Aug 17 21:15:27 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:15:27 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:15:27 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:15:27 user nova-compute[72818]:   </cpu>
Aug 17 21:15:27 user nova-compute[72818]:   <devices>
Aug 17 21:15:27 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:15:27 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:15:27 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk"/>
Aug 17 21:15:27 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:15:27 user nova-compute[72818]:     </disk>
Aug 17 21:15:27 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:15:27 user nova-compute[72818]:       <mac address="fa:16:3e:69:af:13"/>
Aug 17 21:15:27 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:15:27 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:15:27 user nova-compute[72818]:       <target dev="tape94f410f-15"/>
Aug 17 21:15:27 user nova-compute[72818]:     </interface>
Aug 17 21:15:27 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:15:27 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/console.log" append="off"/>
Aug 17 21:15:27 user nova-compute[72818]:     </serial>
Aug 17 21:15:27 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:15:27 user nova-compute[72818]:     <video>
Aug 17 21:15:27 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:15:27 user nova-compute[72818]:     </video>
Aug 17 21:15:27 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:15:27 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:15:27 user nova-compute[72818]:     </rng>
Aug 17 21:15:27 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:15:27 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:15:27 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:15:27 user nova-compute[72818]:     </memballoon>
Aug 17 21:15:27 user nova-compute[72818]:   </devices>
Aug 17 21:15:27 user nova-compute[72818]: </domain>
Aug 17 21:15:27 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1281543925',display_name='tempest-VolumesAdminNegativeTest-server-1281543925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1281543925',id=3,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtFclPFjSP/42/RDUl6TDrox7+s9GiwKes/5lRbYQGq2xerW1PvPXcvnWfT+eHcrWbRmThiUKcPp+BSugRt8X4G8isgmYwFEKZpmUenXJPnsI1hD9NjvgXCQaM/DKoIQQ==',key_name='tempest-keypair-1123154090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f25ddb77be74b0184e1685cd0e34122',ramdisk_id='',reservation_id='r-yxru26xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-342058843',owner_user_name='tempest-VolumesAdminNegativeTest-342058843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a882239cd3054ad3abc93fd0b32a70c7',uuid=b93c6b2f-59ee-4e7f-9805-97ef627eccdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e94f410f-1593-4c05-ae40-a8c34f12c210", "address": "fa:16:3e:69:af:13", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94f410f-15", "ovs_interfaceid": "e94f410f-1593-4c05-ae40-a8c34f12c210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Converting VIF {"id": "e94f410f-1593-4c05-ae40-a8c34f12c210", "address": "fa:16:3e:69:af:13", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94f410f-15", "ovs_interfaceid": "e94f410f-1593-4c05-ae40-a8c34f12c210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:af:13,bridge_name='br-int',has_traffic_filtering=True,id=e94f410f-1593-4c05-ae40-a8c34f12c210,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94f410f-15') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG os_vif [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:af:13,bridge_name='br-int',has_traffic_filtering=True,id=e94f410f-1593-4c05-ae40-a8c34f12c210,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94f410f-15') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape94f410f-15, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape94f410f-15, col_values=(('external_ids', {'iface-id': 'e94f410f-1593-4c05-ae40-a8c34f12c210', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:af:13', 'vm-uuid': 'b93c6b2f-59ee-4e7f-9805-97ef627eccdb'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:27 user nova-compute[72818]: INFO os_vif [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:af:13,bridge_name='br-int',has_traffic_filtering=True,id=e94f410f-1593-4c05-ae40-a8c34f12c210,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94f410f-15')
Aug 17 21:15:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] No VIF found with MAC fa:16:3e:69:af:13, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG nova.network.neutron [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:15:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:15:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG nova.policy [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e7e96b636034002b8994454bc89fdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d5f3696b24e6a8c96af89e7316ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:15:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Creating image(s)
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG nova.network.neutron [req-0c4210ef-c651-46ff-bf06-5d411e647748 req-b77fc4b0-3a71-41a6-9176-51129a047acb service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Updated VIF entry in instance network info cache for port e94f410f-1593-4c05-ae40-a8c34f12c210. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG nova.network.neutron [req-0c4210ef-c651-46ff-bf06-5d411e647748 req-b77fc4b0-3a71-41a6-9176-51129a047acb service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Updating instance_info_cache with network_info: [{"id": "e94f410f-1593-4c05-ae40-a8c34f12c210", "address": "fa:16:3e:69:af:13", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94f410f-15", "ovs_interfaceid": "e94f410f-1593-4c05-ae40-a8c34f12c210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.270s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0c4210ef-c651-46ff-bf06-5d411e647748 req-b77fc4b0-3a71-41a6-9176-51129a047acb service nova] Releasing lock "refresh_cache-b93c6b2f-59ee-4e7f-9805-97ef627eccdb" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.198s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk 1073741824" returned: 0 in 0.095s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Acquiring lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.286s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.008s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:15:29 user nova-compute[72818]: INFO nova.compute.claims [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Claim successful on node user
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Cannot resize image /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG nova.objects.instance [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lazy-loading 'migration_context' on Instance uuid 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Ensure instance console log exists: /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-c154783d-0ec9-4eec-a3c4-8a3b1e018dff req-8ead02c4-3cf6-4564-9757-05b7fe517cfc service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Received event network-vif-plugged-e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c154783d-0ec9-4eec-a3c4-8a3b1e018dff req-8ead02c4-3cf6-4564-9757-05b7fe517cfc service nova] Acquiring lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c154783d-0ec9-4eec-a3c4-8a3b1e018dff req-8ead02c4-3cf6-4564-9757-05b7fe517cfc service nova] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c154783d-0ec9-4eec-a3c4-8a3b1e018dff req-8ead02c4-3cf6-4564-9757-05b7fe517cfc service nova] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-c154783d-0ec9-4eec-a3c4-8a3b1e018dff req-8ead02c4-3cf6-4564-9757-05b7fe517cfc service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] No waiting events found dispatching network-vif-plugged-e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:30 user nova-compute[72818]: WARNING nova.compute.manager [req-c154783d-0ec9-4eec-a3c4-8a3b1e018dff req-8ead02c4-3cf6-4564-9757-05b7fe517cfc service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Received unexpected event network-vif-plugged-e94f410f-1593-4c05-ae40-a8c34f12c210 for instance with vm_state building and task_state spawning.
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.826s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.730s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:15:30 user nova-compute[72818]: INFO nova.compute.claims [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Claim successful on node user
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Successfully created port: 5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:15:30 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.policy [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b41b7c6bc78d41939615b278667f2f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e9f794f16e495787e5e4c98ae3e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:15:30 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Creating image(s)
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "/opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "/opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:15:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG nova.network.neutron [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:15:31 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 17 21:15:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.200s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk 1073741824" returned: 0 in 0.063s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG nova.policy [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3d0732693c441a1a97dc18030f20573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0766e71864a4109b58d68e3eec4c67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.255s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:15:31 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Creating image(s)
Aug 17 21:15:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "/opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "/opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "/opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "1fd8a3249293151f726f4921454c7fdbc67217bd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "1fd8a3249293151f726f4921454c7fdbc67217bd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:31 user nova-compute[72818]: DEBUG nova.network.neutron [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Successfully updated port: 5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd.part --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.network.neutron [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Successfully created port: 5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquired lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.network.neutron [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-c31f544c-7a80-4bd8-ba8f-567b5dbc053a req-f9c9f701-629d-41d7-bdcc-8f3537265752 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-changed-5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-c31f544c-7a80-4bd8-ba8f-567b5dbc053a req-f9c9f701-629d-41d7-bdcc-8f3537265752 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Refreshing instance network info cache due to event network-changed-5e1c71f4-af86-4f7a-8dcf-0210699e469b. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c31f544c-7a80-4bd8-ba8f-567b5dbc053a req-f9c9f701-629d-41d7-bdcc-8f3537265752 service nova] Acquiring lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-32f88bbc-c77f-44a2-96f2-f259a2843eb5 req-4bc45bd3-9ea9-4731-8e30-d75f3a657503 service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Received event network-vif-plugged-e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-32f88bbc-c77f-44a2-96f2-f259a2843eb5 req-4bc45bd3-9ea9-4731-8e30-d75f3a657503 service nova] Acquiring lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-32f88bbc-c77f-44a2-96f2-f259a2843eb5 req-4bc45bd3-9ea9-4731-8e30-d75f3a657503 service nova] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-32f88bbc-c77f-44a2-96f2-f259a2843eb5 req-4bc45bd3-9ea9-4731-8e30-d75f3a657503 service nova] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-32f88bbc-c77f-44a2-96f2-f259a2843eb5 req-4bc45bd3-9ea9-4731-8e30-d75f3a657503 service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] No waiting events found dispatching network-vif-plugged-e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:32 user nova-compute[72818]: WARNING nova.compute.manager [req-32f88bbc-c77f-44a2-96f2-f259a2843eb5 req-4bc45bd3-9ea9-4731-8e30-d75f3a657503 service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Received unexpected event network-vif-plugged-e94f410f-1593-4c05-ae40-a8c34f12c210 for instance with vm_state building and task_state spawning.
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.network.neutron [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Successfully created port: a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json" returned: 0 in 0.797s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Cannot resize image /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.objects.instance [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lazy-loading 'migration_context' on Instance uuid 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Ensure instance console log exists: /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd.part --force-share --output=json" returned: 0 in 0.213s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.images [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] 68302231-6837-4de4-88cf-f348cba7cb65 was qcow2, converting to raw {{(pid=72818) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd.part /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd.converted {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306932.2631648, b93c6b2f-59ee-4e7f-9805-97ef627eccdb => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:32 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] VM Resumed (Lifecycle Event)
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.network.neutron [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:32 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Instance spawned successfully.
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:15:32 user nova-compute[72818]: INFO nova.compute.claims [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Claim successful on node user
Aug 17 21:15:32 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306932.2648041, b93c6b2f-59ee-4e7f-9805-97ef627eccdb => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:32 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] VM Started (Lifecycle Event)
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:32 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd.part /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd.converted" returned: 0 in 0.267s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd.converted --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:32 user nova-compute[72818]: INFO nova.compute.manager [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Took 8.27 seconds to spawn the instance on the hypervisor.
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "1fd8a3249293151f726f4921454c7fdbc67217bd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.320s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.network.neutron [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updating instance_info_cache with network_info: [{"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:15:32 user nova-compute[72818]: INFO nova.compute.manager [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Took 9.22 seconds to build instance.
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Releasing lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Instance network_info: |[{"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c31f544c-7a80-4bd8-ba8f-567b5dbc053a req-f9c9f701-629d-41d7-bdcc-8f3537265752 service nova] Acquired lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.network.neutron [req-c31f544c-7a80-4bd8-ba8f-567b5dbc053a req-f9c9f701-629d-41d7-bdcc-8f3537265752 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Refreshing network info cache for port 5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Start _get_guest_xml network_info=[{"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:15:32 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:15:32 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e2752547-25b7-430f-960b-67de8af407c1 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.414s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178282304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178282304',id=4,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkwVGCdlBlVcOiwisZJ2m7rAADqLOL+kywXDgvAwR2qTgTTFDHWjasH/U7eolNcNHdZLXQQor9tYHlFwFKvEPgekkTkSGi0+Q6MQwEnZ2+/phVBP+RILBn2kgk74jej4g==',key_name='tempest-keypair-1982021055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df7d5f3696b24e6a8c96af89e7316ead',ramdisk_id='',reservation_id='r-3sr5sqxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-330612610',owner_user_name='tempest-TaggedAttachmentsTest-330612610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:15:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e7e96b636034002b8994454bc89fdba',uuid=796d2c15-1728-4cd2-a325-e9385556050f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converting VIF {"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:94:f9,bridge_name='br-int',has_traffic_filtering=True,id=5e1c71f4-af86-4f7a-8dcf-0210699e469b,network=Network(21f97a31-7cb5-43d0-b028-6b1a291f2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1c71f4-af') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.objects.instance [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lazy-loading 'pci_devices' on Instance uuid 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:15:32 user nova-compute[72818]:   <uuid>796d2c15-1728-4cd2-a325-e9385556050f</uuid>
Aug 17 21:15:32 user nova-compute[72818]:   <name>instance-00000004</name>
Aug 17 21:15:32 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:15:32 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:15:32 user nova-compute[72818]:   <metadata>
Aug 17 21:15:32 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:15:32 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:15:32 user nova-compute[72818]:       <nova:name>tempest-device-tagging-server-178282304</nova:name>
Aug 17 21:15:32 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:15:32</nova:creationTime>
Aug 17 21:15:32 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:15:32 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:15:32 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:15:32 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:15:32 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:15:32 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:15:32 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:15:32 user nova-compute[72818]:       <nova:owner>
Aug 17 21:15:32 user nova-compute[72818]:         <nova:user uuid="0e7e96b636034002b8994454bc89fdba">tempest-TaggedAttachmentsTest-330612610-project-member</nova:user>
Aug 17 21:15:32 user nova-compute[72818]:         <nova:project uuid="df7d5f3696b24e6a8c96af89e7316ead">tempest-TaggedAttachmentsTest-330612610</nova:project>
Aug 17 21:15:32 user nova-compute[72818]:       </nova:owner>
Aug 17 21:15:32 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:15:32 user nova-compute[72818]:       <nova:ports>
Aug 17 21:15:32 user nova-compute[72818]:         <nova:port uuid="5e1c71f4-af86-4f7a-8dcf-0210699e469b">
Aug 17 21:15:32 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 21:15:32 user nova-compute[72818]:         </nova:port>
Aug 17 21:15:32 user nova-compute[72818]:       </nova:ports>
Aug 17 21:15:32 user nova-compute[72818]:     </nova:instance>
Aug 17 21:15:32 user nova-compute[72818]:   </metadata>
Aug 17 21:15:32 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:15:32 user nova-compute[72818]:     <system>
Aug 17 21:15:32 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:15:32 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:15:32 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:15:32 user nova-compute[72818]:       <entry name="serial">796d2c15-1728-4cd2-a325-e9385556050f</entry>
Aug 17 21:15:32 user nova-compute[72818]:       <entry name="uuid">796d2c15-1728-4cd2-a325-e9385556050f</entry>
Aug 17 21:15:32 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:15:32 user nova-compute[72818]:     </system>
Aug 17 21:15:32 user nova-compute[72818]:   </sysinfo>
Aug 17 21:15:32 user nova-compute[72818]:   <os>
Aug 17 21:15:32 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:15:32 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:15:32 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:15:32 user nova-compute[72818]:   </os>
Aug 17 21:15:32 user nova-compute[72818]:   <features>
Aug 17 21:15:32 user nova-compute[72818]:     <acpi/>
Aug 17 21:15:32 user nova-compute[72818]:     <apic/>
Aug 17 21:15:32 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:15:32 user nova-compute[72818]:   </features>
Aug 17 21:15:32 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:15:32 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:15:32 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:15:32 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:15:32 user nova-compute[72818]:   </clock>
Aug 17 21:15:32 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:15:32 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:15:32 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:15:32 user nova-compute[72818]:   </cpu>
Aug 17 21:15:32 user nova-compute[72818]:   <devices>
Aug 17 21:15:32 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:15:32 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:15:32 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk"/>
Aug 17 21:15:32 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:15:32 user nova-compute[72818]:     </disk>
Aug 17 21:15:32 user nova-compute[72818]:     <disk type="file" device="cdrom">
Aug 17 21:15:32 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 21:15:32 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk.config"/>
Aug 17 21:15:32 user nova-compute[72818]:       <target dev="hda" bus="ide"/>
Aug 17 21:15:32 user nova-compute[72818]:     </disk>
Aug 17 21:15:32 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:15:32 user nova-compute[72818]:       <mac address="fa:16:3e:1c:94:f9"/>
Aug 17 21:15:32 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:15:32 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:15:32 user nova-compute[72818]:       <target dev="tap5e1c71f4-af"/>
Aug 17 21:15:32 user nova-compute[72818]:     </interface>
Aug 17 21:15:32 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:15:32 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/console.log" append="off"/>
Aug 17 21:15:32 user nova-compute[72818]:     </serial>
Aug 17 21:15:32 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:15:32 user nova-compute[72818]:     <video>
Aug 17 21:15:32 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:15:32 user nova-compute[72818]:     </video>
Aug 17 21:15:32 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:15:32 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:15:32 user nova-compute[72818]:     </rng>
Aug 17 21:15:32 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:15:32 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:15:32 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:15:32 user nova-compute[72818]:     </memballoon>
Aug 17 21:15:32 user nova-compute[72818]:   </devices>
Aug 17 21:15:32 user nova-compute[72818]: </domain>
Aug 17 21:15:32 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178282304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178282304',id=4,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkwVGCdlBlVcOiwisZJ2m7rAADqLOL+kywXDgvAwR2qTgTTFDHWjasH/U7eolNcNHdZLXQQor9tYHlFwFKvEPgekkTkSGi0+Q6MQwEnZ2+/phVBP+RILBn2kgk74jej4g==',key_name='tempest-keypair-1982021055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df7d5f3696b24e6a8c96af89e7316ead',ramdisk_id='',reservation_id='r-3sr5sqxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-330612610',owner_user_name='tempest-TaggedAttachmentsTest-330612610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:15:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e7e96b636034002b8994454bc89fdba',uuid=796d2c15-1728-4cd2-a325-e9385556050f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converting VIF {"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:94:f9,bridge_name='br-int',has_traffic_filtering=True,id=5e1c71f4-af86-4f7a-8dcf-0210699e469b,network=Network(21f97a31-7cb5-43d0-b028-6b1a291f2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1c71f4-af') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG os_vif [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:94:f9,bridge_name='br-int',has_traffic_filtering=True,id=5e1c71f4-af86-4f7a-8dcf-0210699e469b,network=Network(21f97a31-7cb5-43d0-b028-6b1a291f2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1c71f4-af') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd --force-share --output=json" returned: 0 in 0.224s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "1fd8a3249293151f726f4921454c7fdbc67217bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "1fd8a3249293151f726f4921454c7fdbc67217bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e1c71f4-af, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e1c71f4-af, col_values=(('external_ids', {'iface-id': '5e1c71f4-af86-4f7a-8dcf-0210699e469b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:94:f9', 'vm-uuid': '796d2c15-1728-4cd2-a325-e9385556050f'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:33 user nova-compute[72818]: INFO os_vif [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:94:f9,bridge_name='br-int',has_traffic_filtering=True,id=5e1c71f4-af86-4f7a-8dcf-0210699e469b,network=Network(21f97a31-7cb5-43d0-b028-6b1a291f2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1c71f4-af')
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Successfully updated port: a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "refresh_cache-e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquired lock "refresh_cache-e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.798s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] No BDM found with device name hda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] No VIF found with MAC fa:16:3e:1c:94:f9, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:15:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Using config drive
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd --force-share --output=json" returned: 0 in 0.205s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd,backing_fmt=raw /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd,backing_fmt=raw /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk 1073741824" returned: 0 in 0.112s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "1fd8a3249293151f726f4921454c7fdbc67217bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-b08f7c32-6472-4593-bc8d-4615d84b5c25 req-6368ee67-188f-417f-a556-25c03fe7ba39 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Received event network-changed-a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-b08f7c32-6472-4593-bc8d-4615d84b5c25 req-6368ee67-188f-417f-a556-25c03fe7ba39 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Refreshing instance network info cache due to event network-changed-a4e87f77-2469-4b69-b84c-0f41266d2467. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b08f7c32-6472-4593-bc8d-4615d84b5c25 req-6368ee67-188f-417f-a556-25c03fe7ba39 service nova] Acquiring lock "refresh_cache-e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Successfully updated port: 5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Acquiring lock "refresh_cache-3ab89c6a-9eae-4091-b8ab-320f1544d6b9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Acquired lock "refresh_cache-3ab89c6a-9eae-4091-b8ab-320f1544d6b9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:15:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Creating image(s)
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "/opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "/opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "/opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Creating config drive at /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk.config
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyatvcys4 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.policy [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ea750eeca8943b49271dc8ac038a17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61674e45592b48cea88c97dd0366c9e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyatvcys4" returned: 0 in 0.119s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd --force-share --output=json" returned: 0 in 0.346s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.network.neutron [req-c31f544c-7a80-4bd8-ba8f-567b5dbc053a req-f9c9f701-629d-41d7-bdcc-8f3537265752 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updated VIF entry in instance network info cache for port 5e1c71f4-af86-4f7a-8dcf-0210699e469b. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.network.neutron [req-c31f544c-7a80-4bd8-ba8f-567b5dbc053a req-f9c9f701-629d-41d7-bdcc-8f3537265752 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updating instance_info_cache with network_info: [{"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.241s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c31f544c-7a80-4bd8-ba8f-567b5dbc053a req-f9c9f701-629d-41d7-bdcc-8f3537265752 service nova] Releasing lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Cannot resize image /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.objects.instance [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lazy-loading 'migration_context' on Instance uuid e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Updating instance_info_cache with network_info: [{"id": "a4e87f77-2469-4b69-b84c-0f41266d2467", "address": "fa:16:3e:8d:f2:92", "network": {"id": "cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2066928365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0766e71864a4109b58d68e3eec4c67d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4e87f77-24", "ovs_interfaceid": "a4e87f77-2469-4b69-b84c-0f41266d2467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Ensure instance console log exists: /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.014s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Releasing lock "refresh_cache-e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Instance network_info: |[{"id": "a4e87f77-2469-4b69-b84c-0f41266d2467", "address": "fa:16:3e:8d:f2:92", "network": {"id": "cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2066928365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0766e71864a4109b58d68e3eec4c67d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4e87f77-24", "ovs_interfaceid": "a4e87f77-2469-4b69-b84c-0f41266d2467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b08f7c32-6472-4593-bc8d-4615d84b5c25 req-6368ee67-188f-417f-a556-25c03fe7ba39 service nova] Acquired lock "refresh_cache-e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.network.neutron [req-b08f7c32-6472-4593-bc8d-4615d84b5c25 req-6368ee67-188f-417f-a556-25c03fe7ba39 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Refreshing network info cache for port a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Start _get_guest_xml network_info=[{"id": "a4e87f77-2469-4b69-b84c-0f41266d2467", "address": "fa:16:3e:8d:f2:92", "network": {"id": "cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2066928365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0766e71864a4109b58d68e3eec4c67d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4e87f77-24", "ovs_interfaceid": "a4e87f77-2469-4b69-b84c-0f41266d2467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:15:19Z,direct_url=<?>,disk_format='qcow2',id=68302231-6837-4de4-88cf-f348cba7cb65,min_disk=0,min_ram=0,name='',owner='d664b72383cc48baa73c192280a4fa44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:15:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '68302231-6837-4de4-88cf-f348cba7cb65'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:15:34 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:15:34 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:15:19Z,direct_url=<?>,disk_format='qcow2',id=68302231-6837-4de4-88cf-f348cba7cb65,min_disk=0,min_ram=0,name='',owner='d664b72383cc48baa73c192280a4fa44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:15:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1975556709',display_name='tempest-AttachSCSIVolumeTestJSON-server-1975556709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1975556709',id=6,image_ref='68302231-6837-4de4-88cf-f348cba7cb65',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfKFkJs56F3KDUJ9KoKnhLo304OcT+d2HiKFnhQhbROkzoI2FYMtcNpAqjS6fkpWCK5g8TA7xbC3muvN9FL9Pq0tcPUBLi3FH/sW4i23yVGp/YsXvZA4KDFvc8+MRqLWg==',key_name='tempest-keypair-1426333428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0766e71864a4109b58d68e3eec4c67d',ramdisk_id='',reservation_id='r-rswcrczv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68302231-6837-4de4-88cf-f348cba7cb65',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1494896357',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1494896357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:15:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3d0732693c441a1a97dc18030f20573',uuid=e681f6b6-84b7-41c1-b1f7-0726ab0b8f93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4e87f77-2469-4b69-b84c-0f41266d2467", "address": "fa:16:3e:8d:f2:92", "network": {"id": "cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2066928365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0766e71864a4109b58d68e3eec4c67d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4e87f77-24", "ovs_interfaceid": "a4e87f77-2469-4b69-b84c-0f41266d2467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Converting VIF {"id": "a4e87f77-2469-4b69-b84c-0f41266d2467", "address": "fa:16:3e:8d:f2:92", "network": {"id": "cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2066928365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0766e71864a4109b58d68e3eec4c67d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4e87f77-24", "ovs_interfaceid": "a4e87f77-2469-4b69-b84c-0f41266d2467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:f2:92,bridge_name='br-int',has_traffic_filtering=True,id=a4e87f77-2469-4b69-b84c-0f41266d2467,network=Network(cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4e87f77-24') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.objects.instance [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lazy-loading 'pci_devices' on Instance uuid e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:15:34 user nova-compute[72818]:   <uuid>e681f6b6-84b7-41c1-b1f7-0726ab0b8f93</uuid>
Aug 17 21:15:34 user nova-compute[72818]:   <name>instance-00000006</name>
Aug 17 21:15:34 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:15:34 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:15:34 user nova-compute[72818]:   <metadata>
Aug 17 21:15:34 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:15:34 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:15:34 user nova-compute[72818]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1975556709</nova:name>
Aug 17 21:15:34 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:15:34</nova:creationTime>
Aug 17 21:15:34 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:15:34 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:15:34 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:15:34 user nova-compute[72818]:       <nova:owner>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:user uuid="b3d0732693c441a1a97dc18030f20573">tempest-AttachSCSIVolumeTestJSON-1494896357-project-member</nova:user>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:project uuid="b0766e71864a4109b58d68e3eec4c67d">tempest-AttachSCSIVolumeTestJSON-1494896357</nova:project>
Aug 17 21:15:34 user nova-compute[72818]:       </nova:owner>
Aug 17 21:15:34 user nova-compute[72818]:       <nova:root type="image" uuid="68302231-6837-4de4-88cf-f348cba7cb65"/>
Aug 17 21:15:34 user nova-compute[72818]:       <nova:ports>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:port uuid="a4e87f77-2469-4b69-b84c-0f41266d2467">
Aug 17 21:15:34 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 21:15:34 user nova-compute[72818]:         </nova:port>
Aug 17 21:15:34 user nova-compute[72818]:       </nova:ports>
Aug 17 21:15:34 user nova-compute[72818]:     </nova:instance>
Aug 17 21:15:34 user nova-compute[72818]:   </metadata>
Aug 17 21:15:34 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:15:34 user nova-compute[72818]:     <system>
Aug 17 21:15:34 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:15:34 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:15:34 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:15:34 user nova-compute[72818]:       <entry name="serial">e681f6b6-84b7-41c1-b1f7-0726ab0b8f93</entry>
Aug 17 21:15:34 user nova-compute[72818]:       <entry name="uuid">e681f6b6-84b7-41c1-b1f7-0726ab0b8f93</entry>
Aug 17 21:15:34 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:15:34 user nova-compute[72818]:     </system>
Aug 17 21:15:34 user nova-compute[72818]:   </sysinfo>
Aug 17 21:15:34 user nova-compute[72818]:   <os>
Aug 17 21:15:34 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:15:34 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:15:34 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:15:34 user nova-compute[72818]:   </os>
Aug 17 21:15:34 user nova-compute[72818]:   <features>
Aug 17 21:15:34 user nova-compute[72818]:     <acpi/>
Aug 17 21:15:34 user nova-compute[72818]:     <apic/>
Aug 17 21:15:34 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:15:34 user nova-compute[72818]:   </features>
Aug 17 21:15:34 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:15:34 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:15:34 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:15:34 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:15:34 user nova-compute[72818]:   </clock>
Aug 17 21:15:34 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:15:34 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:15:34 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:15:34 user nova-compute[72818]:   </cpu>
Aug 17 21:15:34 user nova-compute[72818]:   <devices>
Aug 17 21:15:34 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:15:34 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:15:34 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk"/>
Aug 17 21:15:34 user nova-compute[72818]:       <target dev="sda" bus="scsi"/>
Aug 17 21:15:34 user nova-compute[72818]:       <address type="drive" controller="0" unit="0"/>
Aug 17 21:15:34 user nova-compute[72818]:     </disk>
Aug 17 21:15:34 user nova-compute[72818]:     <disk type="file" device="cdrom">
Aug 17 21:15:34 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 21:15:34 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk.config"/>
Aug 17 21:15:34 user nova-compute[72818]:       <target dev="sdb" bus="scsi"/>
Aug 17 21:15:34 user nova-compute[72818]:       <address type="drive" controller="0" unit="1"/>
Aug 17 21:15:34 user nova-compute[72818]:     </disk>
Aug 17 21:15:34 user nova-compute[72818]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 17 21:15:34 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:15:34 user nova-compute[72818]:       <mac address="fa:16:3e:8d:f2:92"/>
Aug 17 21:15:34 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:15:34 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:15:34 user nova-compute[72818]:       <target dev="tapa4e87f77-24"/>
Aug 17 21:15:34 user nova-compute[72818]:     </interface>
Aug 17 21:15:34 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:15:34 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/console.log" append="off"/>
Aug 17 21:15:34 user nova-compute[72818]:     </serial>
Aug 17 21:15:34 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:15:34 user nova-compute[72818]:     <video>
Aug 17 21:15:34 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:15:34 user nova-compute[72818]:     </video>
Aug 17 21:15:34 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:15:34 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:15:34 user nova-compute[72818]:     </rng>
Aug 17 21:15:34 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:15:34 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:15:34 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:15:34 user nova-compute[72818]:     </memballoon>
Aug 17 21:15:34 user nova-compute[72818]:   </devices>
Aug 17 21:15:34 user nova-compute[72818]: </domain>
Aug 17 21:15:34 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1975556709',display_name='tempest-AttachSCSIVolumeTestJSON-server-1975556709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1975556709',id=6,image_ref='68302231-6837-4de4-88cf-f348cba7cb65',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfKFkJs56F3KDUJ9KoKnhLo304OcT+d2HiKFnhQhbROkzoI2FYMtcNpAqjS6fkpWCK5g8TA7xbC3muvN9FL9Pq0tcPUBLi3FH/sW4i23yVGp/YsXvZA4KDFvc8+MRqLWg==',key_name='tempest-keypair-1426333428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0766e71864a4109b58d68e3eec4c67d',ramdisk_id='',reservation_id='r-rswcrczv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68302231-6837-4de4-88cf-f348cba7cb65',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1494896357',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1494896357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:15:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3d0732693c441a1a97dc18030f20573',uuid=e681f6b6-84b7-41c1-b1f7-0726ab0b8f93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4e87f77-2469-4b69-b84c-0f41266d2467", "address": "fa:16:3e:8d:f2:92", "network": {"id": "cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2066928365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0766e71864a4109b58d68e3eec4c67d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4e87f77-24", "ovs_interfaceid": "a4e87f77-2469-4b69-b84c-0f41266d2467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Converting VIF {"id": "a4e87f77-2469-4b69-b84c-0f41266d2467", "address": "fa:16:3e:8d:f2:92", "network": {"id": "cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2066928365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0766e71864a4109b58d68e3eec4c67d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4e87f77-24", "ovs_interfaceid": "a4e87f77-2469-4b69-b84c-0f41266d2467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:f2:92,bridge_name='br-int',has_traffic_filtering=True,id=a4e87f77-2469-4b69-b84c-0f41266d2467,network=Network(cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4e87f77-24') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG os_vif [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:f2:92,bridge_name='br-int',has_traffic_filtering=True,id=a4e87f77-2469-4b69-b84c-0f41266d2467,network=Network(cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4e87f77-24') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.257s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4e87f77-24, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4e87f77-24, col_values=(('external_ids', {'iface-id': 'a4e87f77-2469-4b69-b84c-0f41266d2467', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:f2:92', 'vm-uuid': 'e681f6b6-84b7-41c1-b1f7-0726ab0b8f93'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-478062fc-ab64-4413-9d01-40294f5774c2 req-73ee8cb9-7d3f-4652-8cf0-3367705e55f9 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Received event network-changed-5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-478062fc-ab64-4413-9d01-40294f5774c2 req-73ee8cb9-7d3f-4652-8cf0-3367705e55f9 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Refreshing instance network info cache due to event network-changed-5f2bc52b-9615-4568-a036-e17444ab271c. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-478062fc-ab64-4413-9d01-40294f5774c2 req-73ee8cb9-7d3f-4652-8cf0-3367705e55f9 service nova] Acquiring lock "refresh_cache-3ab89c6a-9eae-4091-b8ab-320f1544d6b9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk 1073741824" returned: 0 in 0.070s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:34 user nova-compute[72818]: INFO os_vif [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:f2:92,bridge_name='br-int',has_traffic_filtering=True,id=a4e87f77-2469-4b69-b84c-0f41266d2467,network=Network(cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4e87f77-24')
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.network.neutron [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Updating instance_info_cache with network_info: [{"id": "5f2bc52b-9615-4568-a036-e17444ab271c", "address": "fa:16:3e:fa:ed:ba", "network": {"id": "a856cd30-6b1d-400d-82a6-051a5cb7391d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-375405083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e9f794f16e495787e5e4c98ae3e527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2bc52b-96", "ovs_interfaceid": "5f2bc52b-9615-4568-a036-e17444ab271c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Releasing lock "refresh_cache-3ab89c6a-9eae-4091-b8ab-320f1544d6b9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Instance network_info: |[{"id": "5f2bc52b-9615-4568-a036-e17444ab271c", "address": "fa:16:3e:fa:ed:ba", "network": {"id": "a856cd30-6b1d-400d-82a6-051a5cb7391d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-375405083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e9f794f16e495787e5e4c98ae3e527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2bc52b-96", "ovs_interfaceid": "5f2bc52b-9615-4568-a036-e17444ab271c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-478062fc-ab64-4413-9d01-40294f5774c2 req-73ee8cb9-7d3f-4652-8cf0-3367705e55f9 service nova] Acquired lock "refresh_cache-3ab89c6a-9eae-4091-b8ab-320f1544d6b9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.network.neutron [req-478062fc-ab64-4413-9d01-40294f5774c2 req-73ee8cb9-7d3f-4652-8cf0-3367705e55f9 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Refreshing network info cache for port 5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Start _get_guest_xml network_info=[{"id": "5f2bc52b-9615-4568-a036-e17444ab271c", "address": "fa:16:3e:fa:ed:ba", "network": {"id": "a856cd30-6b1d-400d-82a6-051a5cb7391d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-375405083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e9f794f16e495787e5e4c98ae3e527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2bc52b-96", "ovs_interfaceid": "5f2bc52b-9615-4568-a036-e17444ab271c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] No BDM found with device name sda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] No VIF found with MAC fa:16:3e:8d:f2:92, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:15:34 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Using config drive
Aug 17 21:15:34 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:15:34 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.243s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1264153588',display_name='tempest-VolumesAssistedSnapshotsTest-server-1264153588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1264153588',id=5,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXRRvDdkAHeKHjghkT7vExUmv/El2iD27TGtHWn3CdEkwUHQ6bU0336BWf+e5mxdVefA393sShZ3gA6fKQMaD5zQJcf4tJCJUjv2Zju4MI/VKAKPp29qpvg4FPpitZwrQ==',key_name='tempest-keypair-2068052004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e9f794f16e495787e5e4c98ae3e527',ramdisk_id='',reservation_id='r-4evjnzcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1436073668',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1436073668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:15:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b41b7c6bc78d41939615b278667f2f29',uuid=3ab89c6a-9eae-4091-b8ab-320f1544d6b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f2bc52b-9615-4568-a036-e17444ab271c", "address": "fa:16:3e:fa:ed:ba", "network": {"id": "a856cd30-6b1d-400d-82a6-051a5cb7391d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-375405083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e9f794f16e495787e5e4c98ae3e527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2bc52b-96", "ovs_interfaceid": "5f2bc52b-9615-4568-a036-e17444ab271c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Converting VIF {"id": "5f2bc52b-9615-4568-a036-e17444ab271c", "address": "fa:16:3e:fa:ed:ba", "network": {"id": "a856cd30-6b1d-400d-82a6-051a5cb7391d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-375405083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e9f794f16e495787e5e4c98ae3e527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2bc52b-96", "ovs_interfaceid": "5f2bc52b-9615-4568-a036-e17444ab271c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:ed:ba,bridge_name='br-int',has_traffic_filtering=True,id=5f2bc52b-9615-4568-a036-e17444ab271c,network=Network(a856cd30-6b1d-400d-82a6-051a5cb7391d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2bc52b-96') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.objects.instance [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Successfully created port: f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:15:34 user nova-compute[72818]:   <uuid>3ab89c6a-9eae-4091-b8ab-320f1544d6b9</uuid>
Aug 17 21:15:34 user nova-compute[72818]:   <name>instance-00000005</name>
Aug 17 21:15:34 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:15:34 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:15:34 user nova-compute[72818]:   <metadata>
Aug 17 21:15:34 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:15:34 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:15:34 user nova-compute[72818]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1264153588</nova:name>
Aug 17 21:15:34 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:15:34</nova:creationTime>
Aug 17 21:15:34 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:15:34 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:15:34 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:15:34 user nova-compute[72818]:       <nova:owner>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:user uuid="b41b7c6bc78d41939615b278667f2f29">tempest-VolumesAssistedSnapshotsTest-1436073668-project-member</nova:user>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:project uuid="12e9f794f16e495787e5e4c98ae3e527">tempest-VolumesAssistedSnapshotsTest-1436073668</nova:project>
Aug 17 21:15:34 user nova-compute[72818]:       </nova:owner>
Aug 17 21:15:34 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:15:34 user nova-compute[72818]:       <nova:ports>
Aug 17 21:15:34 user nova-compute[72818]:         <nova:port uuid="5f2bc52b-9615-4568-a036-e17444ab271c">
Aug 17 21:15:34 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 21:15:34 user nova-compute[72818]:         </nova:port>
Aug 17 21:15:34 user nova-compute[72818]:       </nova:ports>
Aug 17 21:15:34 user nova-compute[72818]:     </nova:instance>
Aug 17 21:15:34 user nova-compute[72818]:   </metadata>
Aug 17 21:15:34 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:15:34 user nova-compute[72818]:     <system>
Aug 17 21:15:34 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:15:34 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:15:34 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:15:34 user nova-compute[72818]:       <entry name="serial">3ab89c6a-9eae-4091-b8ab-320f1544d6b9</entry>
Aug 17 21:15:34 user nova-compute[72818]:       <entry name="uuid">3ab89c6a-9eae-4091-b8ab-320f1544d6b9</entry>
Aug 17 21:15:34 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:15:34 user nova-compute[72818]:     </system>
Aug 17 21:15:34 user nova-compute[72818]:   </sysinfo>
Aug 17 21:15:34 user nova-compute[72818]:   <os>
Aug 17 21:15:34 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:15:34 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:15:34 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:15:34 user nova-compute[72818]:   </os>
Aug 17 21:15:34 user nova-compute[72818]:   <features>
Aug 17 21:15:34 user nova-compute[72818]:     <acpi/>
Aug 17 21:15:34 user nova-compute[72818]:     <apic/>
Aug 17 21:15:34 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:15:34 user nova-compute[72818]:   </features>
Aug 17 21:15:34 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:15:34 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:15:34 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:15:34 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:15:34 user nova-compute[72818]:   </clock>
Aug 17 21:15:34 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:15:34 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:15:34 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:15:34 user nova-compute[72818]:   </cpu>
Aug 17 21:15:34 user nova-compute[72818]:   <devices>
Aug 17 21:15:34 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:15:34 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:15:34 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk"/>
Aug 17 21:15:34 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:15:34 user nova-compute[72818]:     </disk>
Aug 17 21:15:34 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:15:34 user nova-compute[72818]:       <mac address="fa:16:3e:fa:ed:ba"/>
Aug 17 21:15:34 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:15:34 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:15:34 user nova-compute[72818]:       <target dev="tap5f2bc52b-96"/>
Aug 17 21:15:34 user nova-compute[72818]:     </interface>
Aug 17 21:15:34 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:15:34 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/console.log" append="off"/>
Aug 17 21:15:34 user nova-compute[72818]:     </serial>
Aug 17 21:15:34 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:15:34 user nova-compute[72818]:     <video>
Aug 17 21:15:34 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:15:34 user nova-compute[72818]:     </video>
Aug 17 21:15:34 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:15:34 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:15:34 user nova-compute[72818]:     </rng>
Aug 17 21:15:34 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:15:34 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:15:34 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:15:34 user nova-compute[72818]:     </memballoon>
Aug 17 21:15:34 user nova-compute[72818]:   </devices>
Aug 17 21:15:34 user nova-compute[72818]: </domain>
Aug 17 21:15:34 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1264153588',display_name='tempest-VolumesAssistedSnapshotsTest-server-1264153588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1264153588',id=5,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXRRvDdkAHeKHjghkT7vExUmv/El2iD27TGtHWn3CdEkwUHQ6bU0336BWf+e5mxdVefA393sShZ3gA6fKQMaD5zQJcf4tJCJUjv2Zju4MI/VKAKPp29qpvg4FPpitZwrQ==',key_name='tempest-keypair-2068052004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e9f794f16e495787e5e4c98ae3e527',ramdisk_id='',reservation_id='r-4evjnzcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1436073668',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1436073668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:15:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b41b7c6bc78d41939615b278667f2f29',uuid=3ab89c6a-9eae-4091-b8ab-320f1544d6b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f2bc52b-9615-4568-a036-e17444ab271c", "address": "fa:16:3e:fa:ed:ba", "network": {"id": "a856cd30-6b1d-400d-82a6-051a5cb7391d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-375405083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e9f794f16e495787e5e4c98ae3e527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2bc52b-96", "ovs_interfaceid": "5f2bc52b-9615-4568-a036-e17444ab271c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Converting VIF {"id": "5f2bc52b-9615-4568-a036-e17444ab271c", "address": "fa:16:3e:fa:ed:ba", "network": {"id": "a856cd30-6b1d-400d-82a6-051a5cb7391d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-375405083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e9f794f16e495787e5e4c98ae3e527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2bc52b-96", "ovs_interfaceid": "5f2bc52b-9615-4568-a036-e17444ab271c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:ed:ba,bridge_name='br-int',has_traffic_filtering=True,id=5f2bc52b-9615-4568-a036-e17444ab271c,network=Network(a856cd30-6b1d-400d-82a6-051a5cb7391d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2bc52b-96') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG os_vif [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:ed:ba,bridge_name='br-int',has_traffic_filtering=True,id=5f2bc52b-9615-4568-a036-e17444ab271c,network=Network(a856cd30-6b1d-400d-82a6-051a5cb7391d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2bc52b-96') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f2bc52b-96, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f2bc52b-96, col_values=(('external_ids', {'iface-id': '5f2bc52b-9615-4568-a036-e17444ab271c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:ed:ba', 'vm-uuid': '3ab89c6a-9eae-4091-b8ab-320f1544d6b9'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:15:34 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Creating config drive at /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk.config
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzpwywvwc {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:34 user nova-compute[72818]: INFO os_vif [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:ed:ba,bridge_name='br-int',has_traffic_filtering=True,id=5f2bc52b-9615-4568-a036-e17444ab271c,network=Network(a856cd30-6b1d-400d-82a6-051a5cb7391d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2bc52b-96')
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.352s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Cannot resize image /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lazy-loading 'migration_context' on Instance uuid 01fcc357-dc4c-4215-b3a5-b9cea51ed532 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzpwywvwc" returned: 0 in 0.076s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Ensure instance console log exists: /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:15:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] No VIF found with MAC fa:16:3e:fa:ed:ba, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-b08f7c32-6472-4593-bc8d-4615d84b5c25 req-6368ee67-188f-417f-a556-25c03fe7ba39 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Updated VIF entry in instance network info cache for port a4e87f77-2469-4b69-b84c-0f41266d2467. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-b08f7c32-6472-4593-bc8d-4615d84b5c25 req-6368ee67-188f-417f-a556-25c03fe7ba39 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Updating instance_info_cache with network_info: [{"id": "a4e87f77-2469-4b69-b84c-0f41266d2467", "address": "fa:16:3e:8d:f2:92", "network": {"id": "cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2066928365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0766e71864a4109b58d68e3eec4c67d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4e87f77-24", "ovs_interfaceid": "a4e87f77-2469-4b69-b84c-0f41266d2467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-478062fc-ab64-4413-9d01-40294f5774c2 req-73ee8cb9-7d3f-4652-8cf0-3367705e55f9 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Updated VIF entry in instance network info cache for port 5f2bc52b-9615-4568-a036-e17444ab271c. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-478062fc-ab64-4413-9d01-40294f5774c2 req-73ee8cb9-7d3f-4652-8cf0-3367705e55f9 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Updating instance_info_cache with network_info: [{"id": "5f2bc52b-9615-4568-a036-e17444ab271c", "address": "fa:16:3e:fa:ed:ba", "network": {"id": "a856cd30-6b1d-400d-82a6-051a5cb7391d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-375405083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e9f794f16e495787e5e4c98ae3e527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2bc52b-96", "ovs_interfaceid": "5f2bc52b-9615-4568-a036-e17444ab271c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-478062fc-ab64-4413-9d01-40294f5774c2 req-73ee8cb9-7d3f-4652-8cf0-3367705e55f9 service nova] Releasing lock "refresh_cache-3ab89c6a-9eae-4091-b8ab-320f1544d6b9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b08f7c32-6472-4593-bc8d-4615d84b5c25 req-6368ee67-188f-417f-a556-25c03fe7ba39 service nova] Releasing lock "refresh_cache-e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Successfully updated port: f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquired lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG nova.compute.manager [req-57a5ae9c-7963-453f-a70f-b0f2a21dec9f req-694b6688-651f-4134-a883-4b44d5643935 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Received event network-changed-f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG nova.compute.manager [req-57a5ae9c-7963-453f-a70f-b0f2a21dec9f req-694b6688-651f-4134-a883-4b44d5643935 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Refreshing instance network info cache due to event network-changed-f445d362-0f87-4071-82f6-8ea4c42fbb4f. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-57a5ae9c-7963-453f-a70f-b0f2a21dec9f req-694b6688-651f-4134-a883-4b44d5643935 service nova] Acquiring lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Updating instance_info_cache with network_info: [{"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Releasing lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Instance network_info: |[{"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-57a5ae9c-7963-453f-a70f-b0f2a21dec9f req-694b6688-651f-4134-a883-4b44d5643935 service nova] Acquired lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.network.neutron [req-57a5ae9c-7963-453f-a70f-b0f2a21dec9f req-694b6688-651f-4134-a883-4b44d5643935 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Refreshing network info cache for port f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Start _get_guest_xml network_info=[{"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:15:36 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:15:36 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1606846035',display_name='tempest-TestVolumeSwap-server-1606846035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1606846035',id=7,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBtOm9NxkO+LlLIZ1zt2HQ05QAzx0rq5/NEq21BT09bJjoa4VLqZPCG7pn1i4JRSovoX2GrqQJplj7foifbKkPiO9FJJGzOgJAqzR/+/0pAIZeww7rZhf75CtTgEKm/WQ==',key_name='tempest-keypair-1231593536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61674e45592b48cea88c97dd0366c9e0',ramdisk_id='',reservation_id='r-z5ri58gh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2120630356',owner_user_name='tempest-TestVolumeSwap-2120630356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:15:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ea750eeca8943b49271dc8ac038a17f',uuid=01fcc357-dc4c-4215-b3a5-b9cea51ed532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Converting VIF {"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ab:48,bridge_name='br-int',has_traffic_filtering=True,id=f445d362-0f87-4071-82f6-8ea4c42fbb4f,network=Network(ecab8083-74b1-4520-b228-7bf3dbcce2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf445d362-0f') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lazy-loading 'pci_devices' on Instance uuid 01fcc357-dc4c-4215-b3a5-b9cea51ed532 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:15:36 user nova-compute[72818]:   <uuid>01fcc357-dc4c-4215-b3a5-b9cea51ed532</uuid>
Aug 17 21:15:36 user nova-compute[72818]:   <name>instance-00000007</name>
Aug 17 21:15:36 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:15:36 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:15:36 user nova-compute[72818]:   <metadata>
Aug 17 21:15:36 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:15:36 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:15:36 user nova-compute[72818]:       <nova:name>tempest-TestVolumeSwap-server-1606846035</nova:name>
Aug 17 21:15:36 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:15:36</nova:creationTime>
Aug 17 21:15:36 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:15:36 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:15:36 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:15:36 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:15:36 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:15:36 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:15:36 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:15:36 user nova-compute[72818]:       <nova:owner>
Aug 17 21:15:36 user nova-compute[72818]:         <nova:user uuid="3ea750eeca8943b49271dc8ac038a17f">tempest-TestVolumeSwap-2120630356-project-member</nova:user>
Aug 17 21:15:36 user nova-compute[72818]:         <nova:project uuid="61674e45592b48cea88c97dd0366c9e0">tempest-TestVolumeSwap-2120630356</nova:project>
Aug 17 21:15:36 user nova-compute[72818]:       </nova:owner>
Aug 17 21:15:36 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:15:36 user nova-compute[72818]:       <nova:ports>
Aug 17 21:15:36 user nova-compute[72818]:         <nova:port uuid="f445d362-0f87-4071-82f6-8ea4c42fbb4f">
Aug 17 21:15:36 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 21:15:36 user nova-compute[72818]:         </nova:port>
Aug 17 21:15:36 user nova-compute[72818]:       </nova:ports>
Aug 17 21:15:36 user nova-compute[72818]:     </nova:instance>
Aug 17 21:15:36 user nova-compute[72818]:   </metadata>
Aug 17 21:15:36 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:15:36 user nova-compute[72818]:     <system>
Aug 17 21:15:36 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:15:36 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:15:36 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:15:36 user nova-compute[72818]:       <entry name="serial">01fcc357-dc4c-4215-b3a5-b9cea51ed532</entry>
Aug 17 21:15:36 user nova-compute[72818]:       <entry name="uuid">01fcc357-dc4c-4215-b3a5-b9cea51ed532</entry>
Aug 17 21:15:36 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:15:36 user nova-compute[72818]:     </system>
Aug 17 21:15:36 user nova-compute[72818]:   </sysinfo>
Aug 17 21:15:36 user nova-compute[72818]:   <os>
Aug 17 21:15:36 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:15:36 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:15:36 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:15:36 user nova-compute[72818]:   </os>
Aug 17 21:15:36 user nova-compute[72818]:   <features>
Aug 17 21:15:36 user nova-compute[72818]:     <acpi/>
Aug 17 21:15:36 user nova-compute[72818]:     <apic/>
Aug 17 21:15:36 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:15:36 user nova-compute[72818]:   </features>
Aug 17 21:15:36 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:15:36 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:15:36 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:15:36 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:15:36 user nova-compute[72818]:   </clock>
Aug 17 21:15:36 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:15:36 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:15:36 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:15:36 user nova-compute[72818]:   </cpu>
Aug 17 21:15:36 user nova-compute[72818]:   <devices>
Aug 17 21:15:36 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:15:36 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:15:36 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk"/>
Aug 17 21:15:36 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:15:36 user nova-compute[72818]:     </disk>
Aug 17 21:15:36 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:15:36 user nova-compute[72818]:       <mac address="fa:16:3e:46:ab:48"/>
Aug 17 21:15:36 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:15:36 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:15:36 user nova-compute[72818]:       <target dev="tapf445d362-0f"/>
Aug 17 21:15:36 user nova-compute[72818]:     </interface>
Aug 17 21:15:36 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:15:36 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/console.log" append="off"/>
Aug 17 21:15:36 user nova-compute[72818]:     </serial>
Aug 17 21:15:36 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:15:36 user nova-compute[72818]:     <video>
Aug 17 21:15:36 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:15:36 user nova-compute[72818]:     </video>
Aug 17 21:15:36 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:15:36 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:15:36 user nova-compute[72818]:     </rng>
Aug 17 21:15:36 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:15:36 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:15:36 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:15:36 user nova-compute[72818]:     </memballoon>
Aug 17 21:15:36 user nova-compute[72818]:   </devices>
Aug 17 21:15:36 user nova-compute[72818]: </domain>
Aug 17 21:15:36 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1606846035',display_name='tempest-TestVolumeSwap-server-1606846035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1606846035',id=7,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBtOm9NxkO+LlLIZ1zt2HQ05QAzx0rq5/NEq21BT09bJjoa4VLqZPCG7pn1i4JRSovoX2GrqQJplj7foifbKkPiO9FJJGzOgJAqzR/+/0pAIZeww7rZhf75CtTgEKm/WQ==',key_name='tempest-keypair-1231593536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61674e45592b48cea88c97dd0366c9e0',ramdisk_id='',reservation_id='r-z5ri58gh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2120630356',owner_user_name='tempest-TestVolumeSwap-2120630356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:15:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ea750eeca8943b49271dc8ac038a17f',uuid=01fcc357-dc4c-4215-b3a5-b9cea51ed532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Converting VIF {"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ab:48,bridge_name='br-int',has_traffic_filtering=True,id=f445d362-0f87-4071-82f6-8ea4c42fbb4f,network=Network(ecab8083-74b1-4520-b228-7bf3dbcce2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf445d362-0f') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG os_vif [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ab:48,bridge_name='br-int',has_traffic_filtering=True,id=f445d362-0f87-4071-82f6-8ea4c42fbb4f,network=Network(ecab8083-74b1-4520-b228-7bf3dbcce2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf445d362-0f') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf445d362-0f, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf445d362-0f, col_values=(('external_ids', {'iface-id': 'f445d362-0f87-4071-82f6-8ea4c42fbb4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:ab:48', 'vm-uuid': '01fcc357-dc4c-4215-b3a5-b9cea51ed532'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:36 user nova-compute[72818]: INFO os_vif [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ab:48,bridge_name='br-int',has_traffic_filtering=True,id=f445d362-0f87-4071-82f6-8ea4c42fbb4f,network=Network(ecab8083-74b1-4520-b228-7bf3dbcce2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf445d362-0f')
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:15:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] No VIF found with MAC fa:16:3e:46:ab:48, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:15:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-57a5ae9c-7963-453f-a70f-b0f2a21dec9f req-694b6688-651f-4134-a883-4b44d5643935 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Updated VIF entry in instance network info cache for port f445d362-0f87-4071-82f6-8ea4c42fbb4f. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:15:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-57a5ae9c-7963-453f-a70f-b0f2a21dec9f req-694b6688-651f-4134-a883-4b44d5643935 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Updating instance_info_cache with network_info: [{"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:15:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-57a5ae9c-7963-453f-a70f-b0f2a21dec9f req-694b6688-651f-4134-a883-4b44d5643935 service nova] Releasing lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:15:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-8a485590-eafe-42df-a718-95c2db9dcaae req-7cce3c39-8742-4dfb-93bb-47f9d95fa4ef service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Received event network-vif-plugged-5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8a485590-eafe-42df-a718-95c2db9dcaae req-7cce3c39-8742-4dfb-93bb-47f9d95fa4ef service nova] Acquiring lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8a485590-eafe-42df-a718-95c2db9dcaae req-7cce3c39-8742-4dfb-93bb-47f9d95fa4ef service nova] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8a485590-eafe-42df-a718-95c2db9dcaae req-7cce3c39-8742-4dfb-93bb-47f9d95fa4ef service nova] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-8a485590-eafe-42df-a718-95c2db9dcaae req-7cce3c39-8742-4dfb-93bb-47f9d95fa4ef service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] No waiting events found dispatching network-vif-plugged-5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:40 user nova-compute[72818]: WARNING nova.compute.manager [req-8a485590-eafe-42df-a718-95c2db9dcaae req-7cce3c39-8742-4dfb-93bb-47f9d95fa4ef service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Received unexpected event network-vif-plugged-5f2bc52b-9615-4568-a036-e17444ab271c for instance with vm_state building and task_state spawning.
Aug 17 21:15:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306940.9993532, 796d2c15-1728-4cd2-a325-e9385556050f => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:41 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] VM Resumed (Lifecycle Event)
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:15:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Instance spawned successfully.
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:41 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306941.0085204, 796d2c15-1728-4cd2-a325-e9385556050f => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:41 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] VM Started (Lifecycle Event)
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:41 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:15:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:41 user nova-compute[72818]: INFO nova.compute.manager [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Took 12.91 seconds to spawn the instance on the hypervisor.
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:41 user nova-compute[72818]: INFO nova.compute.manager [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Took 14.14 seconds to build instance.
Aug 17 21:15:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4b1aede3-d6a9-4a5a-add2-789ee2c58b66 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "796d2c15-1728-4cd2-a325-e9385556050f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.275s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] There are 0 instances to clean {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72818) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:15:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-db2a4c7b-7575-4c24-9eeb-a279a029b1ad req-8e6d0852-b502-4f4e-9e68-2f9507796dac service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-vif-plugged-5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-db2a4c7b-7575-4c24-9eeb-a279a029b1ad req-8e6d0852-b502-4f4e-9e68-2f9507796dac service nova] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-db2a4c7b-7575-4c24-9eeb-a279a029b1ad req-8e6d0852-b502-4f4e-9e68-2f9507796dac service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-db2a4c7b-7575-4c24-9eeb-a279a029b1ad req-8e6d0852-b502-4f4e-9e68-2f9507796dac service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-db2a4c7b-7575-4c24-9eeb-a279a029b1ad req-8e6d0852-b502-4f4e-9e68-2f9507796dac service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] No waiting events found dispatching network-vif-plugged-5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:42 user nova-compute[72818]: WARNING nova.compute.manager [req-db2a4c7b-7575-4c24-9eeb-a279a029b1ad req-8e6d0852-b502-4f4e-9e68-2f9507796dac service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received unexpected event network-vif-plugged-5e1c71f4-af86-4f7a-8dcf-0210699e469b for instance with vm_state active and task_state None.
Aug 17 21:15:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Received event network-vif-plugged-5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] Acquiring lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] No waiting events found dispatching network-vif-plugged-5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:42 user nova-compute[72818]: WARNING nova.compute.manager [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Received unexpected event network-vif-plugged-5f2bc52b-9615-4568-a036-e17444ab271c for instance with vm_state building and task_state spawning.
Aug 17 21:15:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Received event network-vif-plugged-f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] Acquiring lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] No waiting events found dispatching network-vif-plugged-f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:42 user nova-compute[72818]: WARNING nova.compute.manager [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Received unexpected event network-vif-plugged-f445d362-0f87-4071-82f6-8ea4c42fbb4f for instance with vm_state building and task_state spawning.
Aug 17 21:15:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Received event network-vif-plugged-f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] Acquiring lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] No waiting events found dispatching network-vif-plugged-f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:42 user nova-compute[72818]: WARNING nova.compute.manager [req-56f8863f-1477-4637-a63d-fefa21edf4c0 req-1059b0b6-ca07-4214-90a1-0f7ef9735fd1 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Received unexpected event network-vif-plugged-f445d362-0f87-4071-82f6-8ea4c42fbb4f for instance with vm_state building and task_state spawning.
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306943.5580904, 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] VM Resumed (Lifecycle Event)
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Instance spawned successfully.
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Instance spawned successfully.
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Instance spawned successfully.
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306943.5595214, 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] VM Started (Lifecycle Event)
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.compute.manager [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Took 13.15 seconds to spawn the instance on the hypervisor.
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306943.6169536, 01fcc357-dc4c-4215-b3a5-b9cea51ed532 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] VM Resumed (Lifecycle Event)
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.compute.manager [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Took 10.35 seconds to spawn the instance on the hypervisor.
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.compute.manager [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Took 12.43 seconds to spawn the instance on the hypervisor.
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.compute.manager [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Took 14.53 seconds to build instance.
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306943.6182163, 01fcc357-dc4c-4215-b3a5-b9cea51ed532 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] VM Started (Lifecycle Event)
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04bd3c38-77b9-4062-89c9-e682d459c497 tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.889s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:44 user nova-compute[72818]: INFO nova.compute.manager [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Took 14.51 seconds to build instance.
Aug 17 21:15:44 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306943.618301, e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:44 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] VM Resumed (Lifecycle Event)
Aug 17 21:15:44 user nova-compute[72818]: INFO nova.compute.manager [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Took 11.72 seconds to build instance.
Aug 17 21:15:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cff25f03-b59e-454a-878e-5cba49e7ba34 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.668s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f897ca50-a42b-41a5-95ed-d803e63ba3f3 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.915s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692306943.6183705, e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:15:44 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] VM Started (Lifecycle Event)
Aug 17 21:15:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG nova.compute.manager [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-vif-plugged-5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG nova.compute.manager [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] No waiting events found dispatching network-vif-plugged-5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:44 user nova-compute[72818]: WARNING nova.compute.manager [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received unexpected event network-vif-plugged-5e1c71f4-af86-4f7a-8dcf-0210699e469b for instance with vm_state active and task_state None.
Aug 17 21:15:44 user nova-compute[72818]: DEBUG nova.compute.manager [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Received event network-vif-plugged-a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] Acquiring lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG nova.compute.manager [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] No waiting events found dispatching network-vif-plugged-a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:44 user nova-compute[72818]: WARNING nova.compute.manager [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Received unexpected event network-vif-plugged-a4e87f77-2469-4b69-b84c-0f41266d2467 for instance with vm_state active and task_state None.
Aug 17 21:15:44 user nova-compute[72818]: DEBUG nova.compute.manager [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Received event network-vif-plugged-a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] Acquiring lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:44 user nova-compute[72818]: DEBUG nova.compute.manager [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] No waiting events found dispatching network-vif-plugged-a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:15:44 user nova-compute[72818]: WARNING nova.compute.manager [req-d9a695b5-618f-49aa-9dc6-d8e8b0321765 req-08e7e3b4-3f76-4cc0-8171-2659effcbb17 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Received unexpected event network-vif-plugged-a4e87f77-2469-4b69-b84c-0f41266d2467 for instance with vm_state active and task_state None.
Aug 17 21:15:45 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:15:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:15:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:15:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-32d5ecaa-f8b2-4181-9171-f0d78493ffb2" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:15:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-32d5ecaa-f8b2-4181-9171-f0d78493ffb2" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:15:45 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:15:45 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid 32d5ecaa-f8b2-4181-9171-f0d78493ffb2 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:15:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:46 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Updating instance_info_cache with network_info: [{"id": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "address": "fa:16:3e:30:65:83", "network": {"id": "cf8d1111-fc56-453b-87fe-698e5d537fed", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1309064060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eba6109d7274198ba4db4769b64a372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9c960f-9d", "ovs_interfaceid": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:15:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-32d5ecaa-f8b2-4181-9171-f0d78493ffb2" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:15:46 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:15:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:15:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:15:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:15:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:15:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:15:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:15:46 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:15:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:15:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:48 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:15:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:15:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:15:53 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:15:53 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8068MB free_disk=25.865909576416016GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 32d5ecaa-f8b2-4181-9171-f0d78493ffb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b93c6b2f-59ee-4e7f-9805-97ef627eccdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 796d2c15-1728-4cd2-a325-e9385556050f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing inventories for resource provider d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating ProviderTree inventory for provider d156e3af-684d-47e1-a951-585f9c95fa46 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing aggregate associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, aggregates: None {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 21:15:53 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing trait associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 21:15:54 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:15:54 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:15:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:15:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.014s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:15:55 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:15:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:15:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:16:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:16:14 user nova-compute[72818]: DEBUG nova.compute.manager [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:16:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:16:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:16:14 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:16:14 user nova-compute[72818]: INFO nova.compute.claims [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Claim successful on node user
Aug 17 21:16:14 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:16:14 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:16:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:16:14 user nova-compute[72818]: DEBUG nova.compute.manager [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:16:14 user nova-compute[72818]: DEBUG nova.compute.manager [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:16:14 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:16:14 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:16:14 user nova-compute[72818]: DEBUG nova.compute.manager [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:16:14 user nova-compute[72818]: INFO nova.virt.block_device [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Booting with volume fdeb5eb2-02ce-4b50-9da6-11730d812466 at /dev/vda
Aug 17 21:16:14 user nova-compute[72818]: DEBUG nova.policy [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b48b80cf5744a4c94316cfcc3b85f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73943c144849fbb868c847e85b1a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:16:14 user nova-compute[72818]: DEBUG os_brick.utils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:16:15 user nova-compute[72818]: INFO oslo.privsep.daemon [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpho6xt_5q/privsep.sock']
Aug 17 21:16:15 user sudo[83602]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpho6xt_5q/privsep.sock
Aug 17 21:16:15 user sudo[83602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 21:16:15 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Successfully created port: fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:16:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:16 user sudo[83602]: pam_unix(sudo:session): session closed for user root
Aug 17 21:16:16 user nova-compute[72818]: INFO oslo.privsep.daemon [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Spawned new privsep daemon via rootwrap
Aug 17 21:16:16 user nova-compute[72818]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 21:16:16 user nova-compute[72818]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 21:16:16 user nova-compute[72818]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 17 21:16:16 user nova-compute[72818]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83620
Aug 17 21:16:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc15f2b-bea0-4be7-8152-76dd1113d384]: (2,) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:16 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Successfully created port: fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:16:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d881c42-067a-4a25-ad52-4203aabbeadf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:16 user nova-compute[72818]: WARNING os_brick.initiator.connectors.nvmeof [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 17 21:16:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e1797-cafd-4ce7-ae18-1340d1ea2366]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[02be6c50-3e87-4ccc-bc95-daa2d3e56ce1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[145e34fc-52f8-454a-9553-c675a979f3d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:16:17 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:16:17 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd6e8bb-bc2e-4c61-80b0-2b9d1b0387c5]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG os_brick.utils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] <== get_connector_properties: return (2077ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:16:17 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating existing volume attachment record: ae2e408d-540a-4685-b8cb-2915a6ff596b {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:16:18 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Successfully created port: 4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:16:19 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Successfully created port: 4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:16:19 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Successfully created port: 428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:16:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:16:21 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Successfully updated port: fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-b2864bd3-6aca-441c-9e6e-fd29d8060da6 req-3aa00932-ce75-47be-9fb2-6efbfefb4b0f service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-changed-fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-b2864bd3-6aca-441c-9e6e-fd29d8060da6 req-3aa00932-ce75-47be-9fb2-6efbfefb4b0f service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing instance network info cache due to event network-changed-fd598161-5c23-496b-a4bc-6014c311cede. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b2864bd3-6aca-441c-9e6e-fd29d8060da6 req-3aa00932-ce75-47be-9fb2-6efbfefb4b0f service nova] Acquiring lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b2864bd3-6aca-441c-9e6e-fd29d8060da6 req-3aa00932-ce75-47be-9fb2-6efbfefb4b0f service nova] Acquired lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:21 user nova-compute[72818]: DEBUG nova.network.neutron [req-b2864bd3-6aca-441c-9e6e-fd29d8060da6 req-3aa00932-ce75-47be-9fb2-6efbfefb4b0f service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing network info cache for port fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:21 user nova-compute[72818]: DEBUG nova.network.neutron [req-b2864bd3-6aca-441c-9e6e-fd29d8060da6 req-3aa00932-ce75-47be-9fb2-6efbfefb4b0f service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:21 user nova-compute[72818]: DEBUG nova.network.neutron [req-b2864bd3-6aca-441c-9e6e-fd29d8060da6 req-3aa00932-ce75-47be-9fb2-6efbfefb4b0f service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b2864bd3-6aca-441c-9e6e-fd29d8060da6 req-3aa00932-ce75-47be-9fb2-6efbfefb4b0f service nova] Releasing lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:22 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Successfully updated port: 8ceb5790-78d9-4df8-ac63-f5607672129a {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-c78a646b-b39f-40a7-b2e6-e5068b10a59b req-9cd39ee0-f8d8-40b1-ba73-4efa1529b178 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-changed-8ceb5790-78d9-4df8-ac63-f5607672129a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-c78a646b-b39f-40a7-b2e6-e5068b10a59b req-9cd39ee0-f8d8-40b1-ba73-4efa1529b178 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing instance network info cache due to event network-changed-8ceb5790-78d9-4df8-ac63-f5607672129a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c78a646b-b39f-40a7-b2e6-e5068b10a59b req-9cd39ee0-f8d8-40b1-ba73-4efa1529b178 service nova] Acquiring lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c78a646b-b39f-40a7-b2e6-e5068b10a59b req-9cd39ee0-f8d8-40b1-ba73-4efa1529b178 service nova] Acquired lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:23 user nova-compute[72818]: DEBUG nova.network.neutron [req-c78a646b-b39f-40a7-b2e6-e5068b10a59b req-9cd39ee0-f8d8-40b1-ba73-4efa1529b178 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing network info cache for port 8ceb5790-78d9-4df8-ac63-f5607672129a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:23 user nova-compute[72818]: DEBUG nova.network.neutron [req-c78a646b-b39f-40a7-b2e6-e5068b10a59b req-9cd39ee0-f8d8-40b1-ba73-4efa1529b178 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:23 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Successfully updated port: 1a5b3081-03b9-4b82-8470-5192e46ebad3 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:23 user nova-compute[72818]: DEBUG nova.network.neutron [req-c78a646b-b39f-40a7-b2e6-e5068b10a59b req-9cd39ee0-f8d8-40b1-ba73-4efa1529b178 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c78a646b-b39f-40a7-b2e6-e5068b10a59b req-9cd39ee0-f8d8-40b1-ba73-4efa1529b178 service nova] Releasing lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Successfully updated port: fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-0c975084-9c00-4939-a593-4af1f37d52f9 req-7416df3f-a238-4f2b-972a-1318c23081cd service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-changed-fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-0c975084-9c00-4939-a593-4af1f37d52f9 req-7416df3f-a238-4f2b-972a-1318c23081cd service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing instance network info cache due to event network-changed-fbc233f3-63c0-4529-aab0-fb00584462fb. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0c975084-9c00-4939-a593-4af1f37d52f9 req-7416df3f-a238-4f2b-972a-1318c23081cd service nova] Acquiring lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0c975084-9c00-4939-a593-4af1f37d52f9 req-7416df3f-a238-4f2b-972a-1318c23081cd service nova] Acquired lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:24 user nova-compute[72818]: DEBUG nova.network.neutron [req-0c975084-9c00-4939-a593-4af1f37d52f9 req-7416df3f-a238-4f2b-972a-1318c23081cd service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing network info cache for port fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:24 user nova-compute[72818]: DEBUG nova.network.neutron [req-0c975084-9c00-4939-a593-4af1f37d52f9 req-7416df3f-a238-4f2b-972a-1318c23081cd service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-0c975084-9c00-4939-a593-4af1f37d52f9 req-7416df3f-a238-4f2b-972a-1318c23081cd service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0c975084-9c00-4939-a593-4af1f37d52f9 req-7416df3f-a238-4f2b-972a-1318c23081cd service nova] Releasing lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Successfully updated port: 4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:25 user nova-compute[72818]: DEBUG nova.compute.manager [req-a05e83fe-42d6-4160-ba40-586faafb6754 req-048ad1bf-00dd-4499-b2e6-2fd650ff068b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-changed-1a5b3081-03b9-4b82-8470-5192e46ebad3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:25 user nova-compute[72818]: DEBUG nova.compute.manager [req-a05e83fe-42d6-4160-ba40-586faafb6754 req-048ad1bf-00dd-4499-b2e6-2fd650ff068b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing instance network info cache due to event network-changed-1a5b3081-03b9-4b82-8470-5192e46ebad3. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a05e83fe-42d6-4160-ba40-586faafb6754 req-048ad1bf-00dd-4499-b2e6-2fd650ff068b service nova] Acquiring lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a05e83fe-42d6-4160-ba40-586faafb6754 req-048ad1bf-00dd-4499-b2e6-2fd650ff068b service nova] Acquired lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-a05e83fe-42d6-4160-ba40-586faafb6754 req-048ad1bf-00dd-4499-b2e6-2fd650ff068b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing network info cache for port 1a5b3081-03b9-4b82-8470-5192e46ebad3 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-a05e83fe-42d6-4160-ba40-586faafb6754 req-048ad1bf-00dd-4499-b2e6-2fd650ff068b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-a05e83fe-42d6-4160-ba40-586faafb6754 req-048ad1bf-00dd-4499-b2e6-2fd650ff068b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a05e83fe-42d6-4160-ba40-586faafb6754 req-048ad1bf-00dd-4499-b2e6-2fd650ff068b service nova] Releasing lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Successfully updated port: 4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-changed-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing instance network info cache due to event network-changed-4547ebf9-7d38-4301-bf48-b7d0cbb109c3. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] Acquiring lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] Acquired lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing network info cache for port 4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] Releasing lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-changed-4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing instance network info cache due to event network-changed-4f0c45d2-1343-43b8-aadc-53b2229dacd0. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] Acquiring lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] Acquired lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing network info cache for port 4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:27 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Successfully updated port: 428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bf831b22-2c0c-4e2f-b21a-d79e1d76e5a8 req-a7e8b5ca-c6ba-45cb-ac38-f4ce9abbf9c0 service nova] Releasing lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquired lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:27 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:16:27 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:16:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:16:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:16:28 user nova-compute[72818]: INFO nova.compute.claims [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Claim successful on node user
Aug 17 21:16:28 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:16:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:16:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:16:28 user nova-compute[72818]: INFO nova.virt.block_device [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Booting with volume be2f0d88-dc09-4a49-8c8c-bde11b1a157a at /dev/vda
Aug 17 21:16:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-91a81875-1f53-4981-922f-39d0bf89d7fd req-29196830-ade3-4f19-b812-4f8711f3a6bb service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-changed-428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-91a81875-1f53-4981-922f-39d0bf89d7fd req-29196830-ade3-4f19-b812-4f8711f3a6bb service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing instance network info cache due to event network-changed-428b6981-4fb9-4aab-8966-44c4079c7764. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-91a81875-1f53-4981-922f-39d0bf89d7fd req-29196830-ade3-4f19-b812-4f8711f3a6bb service nova] Acquiring lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG nova.policy [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a52192f72fa646ec8422d0e623f9922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8397a213614aa8ae114a39b2669d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG os_brick.utils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[372f989f-8035-40f5-90af-c10007f8eadd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[01144fc9-2831-4a71-b317-45d8781d48bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[29504db9-9156-4e7f-b67f-5ba21774b4f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b18647e-e31e-4369-a70d-b10e439e0601]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:16:28 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:16:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c638082e-f326-45cf-bff3-a3c79f5402ff]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG os_brick.utils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:16:28 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating existing volume attachment record: 91fa70d5-41fe-486f-bae5-680da2293388 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Successfully created port: 69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating instance_info_cache with network_info: [{"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbc233f3-63c0-4529-aab0-fb00584462fb", "address": "fa:16:3e:7b:97:6f", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc233f3-63", "ovs_interfaceid": "fbc233f3-63c0-4529-aab0-fb00584462fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "428b6981-4fb9-4aab-8966-44c4079c7764", "address": "fa:16:3e:5d:55:fd", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428b6981-4f", "ovs_interfaceid": "428b6981-4fb9-4aab-8966-44c4079c7764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Releasing lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Instance network_info: |[{"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbc233f3-63c0-4529-aab0-fb00584462fb", "address": "fa:16:3e:7b:97:6f", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc233f3-63", "ovs_interfaceid": "fbc233f3-63c0-4529-aab0-fb00584462fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "428b6981-4fb9-4aab-8966-44c4079c7764", "address": "fa:16:3e:5d:55:fd", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428b6981-4f", "ovs_interfaceid": "428b6981-4fb9-4aab-8966-44c4079c7764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-91a81875-1f53-4981-922f-39d0bf89d7fd req-29196830-ade3-4f19-b812-4f8711f3a6bb service nova] Acquired lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG nova.network.neutron [req-91a81875-1f53-4981-922f-39d0bf89d7fd req-29196830-ade3-4f19-b812-4f8711f3a6bb service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing network info cache for port 428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:29 user nova-compute[72818]: INFO nova.virt.block_device [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Booting with volume 79478458-0a3e-42eb-921c-b86a47887e46 at /dev/vdb
Aug 17 21:16:29 user nova-compute[72818]: DEBUG os_brick.utils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1855dd-acc7-4a0b-94be-304ae60cbe07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd04eed-471f-4053-9b7c-6fa08136bff8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b965a37-17ca-4fb2-a746-069c5bbc0cda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3ccd02-d104-47fe-94f9-b056a63b3d7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:16:29 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:16:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b42c956-6c61-45f4-abee-6a2afb9c83a6]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG os_brick.utils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:16:29 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating existing volume attachment record: dd93d46d-236d-49ca-8104-d78dabb8db44 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:16:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Successfully created port: bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:16:30 user nova-compute[72818]: DEBUG nova.network.neutron [req-91a81875-1f53-4981-922f-39d0bf89d7fd req-29196830-ade3-4f19-b812-4f8711f3a6bb service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updated VIF entry in instance network info cache for port 428b6981-4fb9-4aab-8966-44c4079c7764. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:16:30 user nova-compute[72818]: DEBUG nova.network.neutron [req-91a81875-1f53-4981-922f-39d0bf89d7fd req-29196830-ade3-4f19-b812-4f8711f3a6bb service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating instance_info_cache with network_info: [{"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbc233f3-63c0-4529-aab0-fb00584462fb", "address": "fa:16:3e:7b:97:6f", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc233f3-63", "ovs_interfaceid": "fbc233f3-63c0-4529-aab0-fb00584462fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "428b6981-4fb9-4aab-8966-44c4079c7764", "address": "fa:16:3e:5d:55:fd", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428b6981-4f", "ovs_interfaceid": "428b6981-4fb9-4aab-8966-44c4079c7764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-91a81875-1f53-4981-922f-39d0bf89d7fd req-29196830-ade3-4f19-b812-4f8711f3a6bb service nova] Releasing lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Successfully created port: b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:16:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:31 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Successfully created port: 9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:16:31 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Successfully created port: 7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:16:32 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Successfully updated port: 69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-2e59298d-5a51-4b03-ba19-607337b4193b req-d77f3b85-e32e-4404-9462-65acd92fccb1 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-changed-69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-2e59298d-5a51-4b03-ba19-607337b4193b req-d77f3b85-e32e-4404-9462-65acd92fccb1 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing instance network info cache due to event network-changed-69dadb43-0aba-4637-a9ac-b7214b9f37b0. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2e59298d-5a51-4b03-ba19-607337b4193b req-d77f3b85-e32e-4404-9462-65acd92fccb1 service nova] Acquiring lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2e59298d-5a51-4b03-ba19-607337b4193b req-d77f3b85-e32e-4404-9462-65acd92fccb1 service nova] Acquired lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:32 user nova-compute[72818]: DEBUG nova.network.neutron [req-2e59298d-5a51-4b03-ba19-607337b4193b req-d77f3b85-e32e-4404-9462-65acd92fccb1 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing network info cache for port 69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:32 user nova-compute[72818]: DEBUG nova.network.neutron [req-2e59298d-5a51-4b03-ba19-607337b4193b req-d77f3b85-e32e-4404-9462-65acd92fccb1 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:33 user nova-compute[72818]: DEBUG nova.network.neutron [req-2e59298d-5a51-4b03-ba19-607337b4193b req-d77f3b85-e32e-4404-9462-65acd92fccb1 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2e59298d-5a51-4b03-ba19-607337b4193b req-d77f3b85-e32e-4404-9462-65acd92fccb1 service nova] Releasing lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Successfully updated port: 26243f2d-fe21-428b-b9bf-a1358aa60158 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:34 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Successfully updated port: d7aef91f-c547-400d-abf5-6da4ab08a52f {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG nova.compute.manager [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-changed-26243f2d-fe21-428b-b9bf-a1358aa60158 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG nova.compute.manager [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing instance network info cache due to event network-changed-26243f2d-fe21-428b-b9bf-a1358aa60158. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] Acquiring lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] Acquired lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing network info cache for port 26243f2d-fe21-428b-b9bf-a1358aa60158 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Successfully updated port: bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] Releasing lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG nova.compute.manager [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-changed-d7aef91f-c547-400d-abf5-6da4ab08a52f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG nova.compute.manager [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing instance network info cache due to event network-changed-d7aef91f-c547-400d-abf5-6da4ab08a52f. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] Acquiring lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] Acquired lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing network info cache for port d7aef91f-c547-400d-abf5-6da4ab08a52f {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:36 user nova-compute[72818]: DEBUG nova.network.neutron [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0c4f166-8133-4036-8ade-00cabc784846 req-ef3437b3-def7-4835-b1d3-d804e7699db6 service nova] Releasing lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:16:36 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Successfully updated port: b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-changed-bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing instance network info cache due to event network-changed-bdd056c9-17af-4dfa-bf6b-a892b20bd869. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] Acquiring lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] Acquired lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing network info cache for port bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Successfully updated port: 9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] Releasing lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-changed-b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing instance network info cache due to event network-changed-b45072f7-8d1e-4d77-875e-92172d9ad7d7. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] Acquiring lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] Acquired lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing network info cache for port b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-18b9f93f-f928-42a3-abe2-1bae2e5289dc req-dd37e918-0144-47fb-b248-ffb24c8c4a40 service nova] Releasing lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:38 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Successfully updated port: 7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:16:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquired lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:38 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:16:38 user nova-compute[72818]: DEBUG nova.compute.manager [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:16:38 user nova-compute[72818]: INFO nova.compute.manager [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] instance snapshotting
Aug 17 21:16:38 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:16:38 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Beginning live snapshot process
Aug 17 21:16:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json -f qcow2 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json -f qcow2 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:39 user nova-compute[72818]: DEBUG nova.compute.manager [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-changed-9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:39 user nova-compute[72818]: DEBUG nova.compute.manager [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing instance network info cache due to event network-changed-9b783d7f-a2aa-459d-9602-3d30eb4ac08c. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] Acquiring lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json -f qcow2" returned: 0 in 0.241s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt6xl_sjj/f1dbe2bcd7224c37943b735e7fbcb4dc.delta 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt6xl_sjj/f1dbe2bcd7224c37943b735e7fbcb4dc.delta 1073741824" returned: 0 in 0.054s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:39 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 21:16:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72818) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 17 21:16:39 user nova-compute[72818]: INFO nova.virt.libvirt.host [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] UEFI support detected
Aug 17 21:16:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72818) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 21:16:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72818) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 21:16:40 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 21:16:40 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:16:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt6xl_sjj/f1dbe2bcd7224c37943b735e7fbcb4dc.delta /opt/stack/data/nova/instances/snapshots/tmpt6xl_sjj/f1dbe2bcd7224c37943b735e7fbcb4dc {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [{"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "address": "fa:16:3e:9b:c5:5d", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b783d7f-a2", "ovs_interfaceid": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Releasing lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Instance network_info: |[{"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "address": "fa:16:3e:9b:c5:5d", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b783d7f-a2", "ovs_interfaceid": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] Acquired lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG nova.network.neutron [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing network info cache for port 9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG nova.objects.instance [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lazy-loading 'flavor' on Instance uuid 32d5ecaa-f8b2-4181-9171-f0d78493ffb2 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.196s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt6xl_sjj/f1dbe2bcd7224c37943b735e7fbcb4dc.delta /opt/stack/data/nova/instances/snapshots/tmpt6xl_sjj/f1dbe2bcd7224c37943b735e7fbcb4dc" returned: 0 in 0.850s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Snapshot extracted, beginning image upload
Aug 17 21:16:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:16:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:16:41 user nova-compute[72818]: INFO nova.compute.manager [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Attaching volume 87c72c23-a8dd-4497-ad05-7f6dade47ff8 to /dev/vdb
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.utils [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cc4e92-7593-4cc8-9ba2-0f141bf8637e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5de5b19-219f-4575-a761-cbfa8e69a246]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc8261b-7563-460f-8692-9bfe152c75f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7214a14-3167-499c-b735-d3e9b722bd05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG nova.network.neutron [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updated VIF entry in instance network info cache for port 9b783d7f-a2aa-459d-9602-3d30eb4ac08c. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG nova.network.neutron [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [{"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "address": "fa:16:3e:9b:c5:5d", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b783d7f-a2", "ovs_interfaceid": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:16:42 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[22073ffe-7949-401c-aea0-397ac8e7a863]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.utils [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Updating existing volume attachment record: 1a078b15-f03b-4d67-85d9-930b23ef042f {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:16:42 user nova-compute[72818]: INFO nova.virt.block_device [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Booting with volume ba0c56f6-aaef-4f42-8704-f37701694b3b at /dev/vdb
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] Releasing lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-changed-7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing instance network info cache due to event network-changed-7851b371-1f54-4adc-af39-dd6e60f98e9d. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] Acquiring lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] Acquired lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG nova.network.neutron [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing network info cache for port 7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.utils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0351074-fa15-4fa4-b809-193c7df01cda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: INFO nova.virt.block_device [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Booting with volume 6db0bd26-6a04-4259-aaa1-144cd0864d1e at /dev/vdc
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[34470860-399c-4a86-a7a8-0f1c5f444b10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e84018-d487-4b24-95b8-9ac23165b48f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f08d923-eb0d-4755-85a8-f09290db3b1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.utils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:16:42 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[91085927-ac8c-415c-a061-5a7217f81cab]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.utils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating existing volume attachment record: 50acf1f3-8684-4875-9d33-671b2c7c032b {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f9f1f2-0bad-4242-9135-f2f52d21b7eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[167c9310-bac4-45bf-92c4-027ca2fe5199]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0cbd65-87a0-4152-ae9a-84ad5b97b67c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99e095d-7927-4e1c-b200-61c1849d36e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:16:42 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b851790-9570-4558-8b5f-98fbf17c374d]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG os_brick.utils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating existing volume attachment record: 2b72128f-d7b5-4fa1-8e27-5e8d24af37aa {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG nova.network.neutron [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updated VIF entry in instance network info cache for port 7851b371-1f54-4adc-af39-dd6e60f98e9d. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG nova.network.neutron [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [{"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "address": "fa:16:3e:9b:c5:5d", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b783d7f-a2", "ovs_interfaceid": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-430bdaa9-9d56-42c5-846a-dc00cb3de883 req-0ee21056-1932-419c-b37c-be0a6ea1b15e service nova] Releasing lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:44 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:16:44 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Snapshot image upload complete
Aug 17 21:16:44 user nova-compute[72818]: INFO nova.compute.manager [None req-24d4cab1-0ccf-4d62-8dfd-2318ab2240f5 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Took 6.53 seconds to snapshot the instance on the hypervisor.
Aug 17 21:16:45 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:16:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:16:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:16:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:16:45 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:16:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:16:46 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Updating instance_info_cache with network_info: [{"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:16:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:16:46 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:16:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:16:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:16:47 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:16:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:16:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:16:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:16:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:16:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:16:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:16:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:16:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:16:48 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:16:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:52 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:16:52 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7678MB free_disk=25.68852996826172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 32d5ecaa-f8b2-4181-9171-f0d78493ffb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b93c6b2f-59ee-4e7f-9805-97ef627eccdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 796d2c15-1728-4cd2-a325-e9385556050f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance a4618087-b551-4cc4-b50e-5276bb8395cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 279a0c9c-91a3-4c5b-8918-b1a9278b59ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:16:52 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:16:53 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:16:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.compute.manager [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:16:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Creating image(s)
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Ensure instance console log exists: /opt/stack/data/nova/instances/a4618087-b551-4cc4-b50e-5276bb8395cd/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Start _get_guest_xml network_info=[{"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbc233f3-63c0-4529-aab0-fb00584462fb", "address": "fa:16:3e:7b:97:6f", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc233f3-63", "ovs_interfaceid": "fbc233f3-63c0-4529-aab0-fb00584462fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "428b6981-4fb9-4aab-8966-44c4079c7764", "address": "fa:16:3e:5d:55:fd", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428b6981-4f", "ovs_interfaceid": "428b6981-4fb9-4aab-8966-44c4079c7764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'ae2e408d-540a-4685-b8cb-2915a6ff596b', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXxrdsyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4618087-b551-4cc4-b50e-5276bb8395cd', 'attached_at': '', 'detached_at': '', 'volume_id': 'fdeb5eb2-02ce-4b50-9da6-11730d812466', 'serial': 'fdeb5eb2-02ce-4b50-9da6-11730d812466'}, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 1, 'attachment_id': 'dd93d46d-236d-49ca-8104-d78dabb8db44', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFVKANHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4618087-b551-4cc4-b50e-5276bb8395cd', 'attached_at': '', 'detached_at': '', 'volume_id': '79478458-0a3e-42eb-921c-b86a47887e46', 'serial': '79478458-0a3e-42eb-921c-b86a47887e46'}, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 2, 'attachment_id': '2b72128f-d7b5-4fa1-8e27-5e8d24af37aa', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMKGpCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4618087-b551-4cc4-b50e-5276bb8395cd', 'attached_at': '', 'detached_at': '', 'volume_id': '6db0bd26-6a04-4259-aaa1-144cd0864d1e', 'serial': '6db0bd26-6a04-4259-aaa1-144cd0864d1e'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:16:55 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:16:55 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connector [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Factory for ISCSI on None {{(pid=72818) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXxrdsyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:16:55 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:16:55 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:16:55 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d4ed11-9c8d-48f6-ada9-b059f018093b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:16:55 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb37f95-a6ae-4f2b-aca9-5263afa9d3ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466] added
Aug 17 21:16:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecab4c83-f492-4697-ab4d-d70b41259e4d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[11037d1a-5996-4441-a371-4340fbe187ec]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXxrdsyw {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXxrdsyw" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae08fd0-82b5-4e78-a0ba-c02b323dfeda]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oXxrdsyw'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f88c95e-d6d4-4507-bd41-2772feb91796]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[999266be-359b-4a89-911a-83111a29970e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:16:55 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:16:55 user nova-compute[72818]:  {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:16:55 user nova-compute[72818]: WARNING os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 21:16:55 user nova-compute[72818]: 
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb8215d-80b2-429c-8ad4-424bedcccf34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466, portal: 172.16.0.220,3260]
Aug 17 21:16:55 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466, portal: 172.16.0.220,3260] successful.
Aug 17 21:16:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0ef36e-0475-4d32-b710-d2efed237ae3]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c7eb05-1131-41a1-99f0-44c42ac2c147]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d2780d-941b-4c42-9bee-7cbf5b556de5]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXxrdsyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:16:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26630646163386231', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630646163386231', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFVKANHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:16:56 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:16:56 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:16:56 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d53793-946e-4c64-ad6e-ee7b786b3b40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:16:56 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb910b8-c599-465e-8de8-dc3ed144d2c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46] added
Aug 17 21:16:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[76072699-64a3-47f8-9f66-7240a562c5c0]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3e9c7c-73aa-4207-a48e-fab4d0d817d2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFVKANHS {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFVKANHS" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[76671ab3-7d3b-49c2-aa7b-55226e5534d7]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RFVKANHS'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.060s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31e1647-f950-4199-8cc6-cdd4a4b9ec9b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a84105-b7f5-471d-aad7-da953eda1c02]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[671feb99-8a81-4f04-b800-47e7403410cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46, portal: 172.16.0.220,3260]
Aug 17 21:16:56 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46, portal: 172.16.0.220,3260] successful.
Aug 17 21:16:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d088de26-5b62-4b23-8f30-3b06f13585ef]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3957f2-0f85-4412-b875-eea0537eac8c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:56 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:16:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:56 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:16:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a6df32-08cd-4e60-89c8-6bc9302deee6]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFVKANHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwCuUSrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:16:56 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:16:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23236316663343530', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236316663343530', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.912s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:16:57 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:16:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:16:57 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:16:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMKGpCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:16:57 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:16:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b13c0a-6c6b-4849-8925-2b17590d52c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:16:57 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa35d18-ceab-409d-bcc5-875d4b707b6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8] added
Aug 17 21:16:57 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d40d72-dee7-4c86-8fef-ae8f4f6513e7]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aca399-81b3-4d86-9eee-f678c764f581]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwCuUSrW {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwCuUSrW" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ab7ba2-05a7-4665-9044-ad775d6f48da]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VwCuUSrW'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[953bbccd-2d20-48dd-b579-1aa411d71558]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fa43d9-4f35-4724-9e87-ea20c79a58e8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:58 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:16:58 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:58 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:16:58 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c465ac-e28c-4e65-9596-06f63f91df68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8, portal: 172.16.0.220,3260]
Aug 17 21:16:58 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8, portal: 172.16.0.220,3260] successful.
Aug 17 21:16:58 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[93caf664-141e-496e-a400-f23986aa1262]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc98ff9d-6686-44d8-88b3-13b99e7c96c5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:58 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:16:58 user nova-compute[72818]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 (non-flash)
Aug 17 21:16:58 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:58 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:16:58 user nova-compute[72818]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 (non-flash)
Aug 17 21:16:58 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa7cf6e-bff7-43cf-b107-93b1357432ff]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:16:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwCuUSrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] <== connect_volume: return (2287ms) {'type': 'block', 'scsi_wwn': '26439366132306130', 'path': '/dev/sdd'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439366132306130', 'path': '/dev/sdd'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.339s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:16:59 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:16:59 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG nova.objects.instance [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lazy-loading 'flavor' on Instance uuid 32d5ecaa-f8b2-4181-9171-f0d78493ffb2 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e9b3f2-476a-4ea9-8134-74fbc05c575d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:16:59 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:16:59 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:16:59 user nova-compute[72818]:   <source dev="/dev/sdd"/>
Aug 17 21:16:59 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:16:59 user nova-compute[72818]:   <serial>87c72c23-a8dd-4497-ad05-7f6dade47ff8</serial>
Aug 17 21:16:59 user nova-compute[72818]: </disk>
Aug 17 21:16:59 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b009df-008a-4ff0-a5c7-09ea6e93f4ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e] added
Aug 17 21:16:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a5944b-fff1-4030-85e2-3774c00d8576]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfbb7cb-3401-4851-9602-0cf103158a62]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvMKGpCR {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvMKGpCR" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[35057819-c65d-4480-9c3a-47a1083302f2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvMKGpCR'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7427a12-7790-4dd6-89f5-b2399d0126b3]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b716ad-4924-4ce1-b2f2-8d095d4b39c8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:59 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:16:59 user nova-compute[72818]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 (non-flash)
Aug 17 21:16:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:59 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:16:59 user nova-compute[72818]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 (non-flash)
Aug 17 21:16:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5bc0e0-23d8-4952-8918-773bc7b1e17a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e, portal: 172.16.0.220,3260]
Aug 17 21:16:59 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e, portal: 172.16.0.220,3260] successful.
Aug 17 21:16:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c86e84-8b76-47d3-911d-ed8e2ac78826]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[925de574-a36f-4110-83f6-df9e3cf55b6c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:59 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:16:59 user nova-compute[72818]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 (non-flash)
Aug 17 21:16:59 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:16:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:16:59 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:16:59 user nova-compute[72818]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 (non-flash)
Aug 17 21:16:59 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:16:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[829358a1-4676-4474-af65-14810148add6]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMKGpCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:16:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] No VIF found with MAC fa:16:3e:30:65:83, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6ac804ba-6cc7-49b7-bcf0-470e67023848 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.084s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:00 user nova-compute[72818]: INFO nova.compute.manager [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Terminating instance
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] <== connect_volume: return (2698ms) {'type': 'block', 'scsi_wwn': '23763383332613964', 'path': '/dev/sde'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763383332613964', 'path': '/dev/sde'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:e7:63,bridge_name='br-int',has_traffic_filtering=True,id=fd598161-5c23-496b-a4bc-6014c311cede,network=Network(3c0386bc-b1c7-4730-a896-e935a72c6e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd598161-5c') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:21:0a,bridge_name='br-int',has_traffic_filtering=True,id=8ceb5790-78d9-4df8-ac63-f5607672129a,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ceb5790-78') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cf:24,bridge_name='br-int',has_traffic_filtering=True,id=1a5b3081-03b9-4b82-8470-5192e46ebad3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1a5b3081-03') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbc233f3-63c0-4529-aab0-fb00584462fb", "address": "fa:16:3e:7b:97:6f", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc233f3-63", "ovs_interfaceid": "fbc233f3-63c0-4529-aab0-fb00584462fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "fbc233f3-63c0-4529-aab0-fb00584462fb", "address": "fa:16:3e:7b:97:6f", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc233f3-63", "ovs_interfaceid": "fbc233f3-63c0-4529-aab0-fb00584462fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:97:6f,bridge_name='br-int',has_traffic_filtering=True,id=fbc233f3-63c0-4529-aab0-fb00584462fb,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc233f3-63') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:63,bridge_name='br-int',has_traffic_filtering=True,id=4547ebf9-7d38-4301-bf48-b7d0cbb109c3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4547ebf9-7d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:60:81,bridge_name='br-int',has_traffic_filtering=True,id=4f0c45d2-1343-43b8-aadc-53b2229dacd0,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f0c45d2-13') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "428b6981-4fb9-4aab-8966-44c4079c7764", "address": "fa:16:3e:5d:55:fd", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428b6981-4f", "ovs_interfaceid": "428b6981-4fb9-4aab-8966-44c4079c7764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "428b6981-4fb9-4aab-8966-44c4079c7764", "address": "fa:16:3e:5d:55:fd", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428b6981-4f", "ovs_interfaceid": "428b6981-4fb9-4aab-8966-44c4079c7764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:55:fd,bridge_name='br-int',has_traffic_filtering=True,id=428b6981-4fb9-4aab-8966-44c4079c7764,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428b6981-4f') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.objects.instance [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lazy-loading 'pci_devices' on Instance uuid a4618087-b551-4cc4-b50e-5276bb8395cd {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:17:00 user nova-compute[72818]:   <uuid>a4618087-b551-4cc4-b50e-5276bb8395cd</uuid>
Aug 17 21:17:00 user nova-compute[72818]:   <name>instance-00000008</name>
Aug 17 21:17:00 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:17:00 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:17:00 user nova-compute[72818]:   <metadata>
Aug 17 21:17:00 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:17:00 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:17:00 user nova-compute[72818]:       <nova:name>tempest-device-tagging-server-801175330</nova:name>
Aug 17 21:17:00 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:16:55</nova:creationTime>
Aug 17 21:17:00 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:17:00 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:17:00 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:17:00 user nova-compute[72818]:       <nova:owner>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:user uuid="5b48b80cf5744a4c94316cfcc3b85f6a">tempest-TaggedBootDevicesTest-543470781-project-member</nova:user>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:project uuid="5d73943c144849fbb868c847e85b1a3b">tempest-TaggedBootDevicesTest-543470781</nova:project>
Aug 17 21:17:00 user nova-compute[72818]:       </nova:owner>
Aug 17 21:17:00 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:17:00 user nova-compute[72818]:       <nova:ports>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:port uuid="fd598161-5c23-496b-a4bc-6014c311cede">
Aug 17 21:17:00 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 21:17:00 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:port uuid="8ceb5790-78d9-4df8-ac63-f5607672129a">
Aug 17 21:17:00 user nova-compute[72818]:           <nova:ip type="fixed" address="10.1.1.55" ipVersion="4"/>
Aug 17 21:17:00 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:port uuid="1a5b3081-03b9-4b82-8470-5192e46ebad3">
Aug 17 21:17:00 user nova-compute[72818]:           <nova:ip type="fixed" address="10.1.1.147" ipVersion="4"/>
Aug 17 21:17:00 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:port uuid="fbc233f3-63c0-4529-aab0-fb00584462fb">
Aug 17 21:17:00 user nova-compute[72818]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
Aug 17 21:17:00 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:port uuid="4547ebf9-7d38-4301-bf48-b7d0cbb109c3">
Aug 17 21:17:00 user nova-compute[72818]:           <nova:ip type="fixed" address="10.1.1.251" ipVersion="4"/>
Aug 17 21:17:00 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:port uuid="4f0c45d2-1343-43b8-aadc-53b2229dacd0">
Aug 17 21:17:00 user nova-compute[72818]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 21:17:00 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:00 user nova-compute[72818]:         <nova:port uuid="428b6981-4fb9-4aab-8966-44c4079c7764">
Aug 17 21:17:00 user nova-compute[72818]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 21:17:00 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:00 user nova-compute[72818]:       </nova:ports>
Aug 17 21:17:00 user nova-compute[72818]:     </nova:instance>
Aug 17 21:17:00 user nova-compute[72818]:   </metadata>
Aug 17 21:17:00 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:17:00 user nova-compute[72818]:     <system>
Aug 17 21:17:00 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:17:00 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:17:00 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:17:00 user nova-compute[72818]:       <entry name="serial">a4618087-b551-4cc4-b50e-5276bb8395cd</entry>
Aug 17 21:17:00 user nova-compute[72818]:       <entry name="uuid">a4618087-b551-4cc4-b50e-5276bb8395cd</entry>
Aug 17 21:17:00 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:17:00 user nova-compute[72818]:     </system>
Aug 17 21:17:00 user nova-compute[72818]:   </sysinfo>
Aug 17 21:17:00 user nova-compute[72818]:   <os>
Aug 17 21:17:00 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:17:00 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:17:00 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:17:00 user nova-compute[72818]:   </os>
Aug 17 21:17:00 user nova-compute[72818]:   <features>
Aug 17 21:17:00 user nova-compute[72818]:     <acpi/>
Aug 17 21:17:00 user nova-compute[72818]:     <apic/>
Aug 17 21:17:00 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:17:00 user nova-compute[72818]:   </features>
Aug 17 21:17:00 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:17:00 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:17:00 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:17:00 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:17:00 user nova-compute[72818]:   </clock>
Aug 17 21:17:00 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:17:00 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:17:00 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:17:00 user nova-compute[72818]:   </cpu>
Aug 17 21:17:00 user nova-compute[72818]:   <devices>
Aug 17 21:17:00 user nova-compute[72818]:     <disk type="file" device="cdrom">
Aug 17 21:17:00 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 21:17:00 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/a4618087-b551-4cc4-b50e-5276bb8395cd/disk.config"/>
Aug 17 21:17:00 user nova-compute[72818]:       <target dev="hda" bus="ide"/>
Aug 17 21:17:00 user nova-compute[72818]:     </disk>
Aug 17 21:17:00 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:17:00 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:00 user nova-compute[72818]:       <source dev="/dev/sdb"/>
Aug 17 21:17:00 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:17:00 user nova-compute[72818]:       <serial>fdeb5eb2-02ce-4b50-9da6-11730d812466</serial>
Aug 17 21:17:00 user nova-compute[72818]:     </disk>
Aug 17 21:17:00 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:17:00 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:00 user nova-compute[72818]:       <source dev="/dev/sdc"/>
Aug 17 21:17:00 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:17:00 user nova-compute[72818]:       <serial>79478458-0a3e-42eb-921c-b86a47887e46</serial>
Aug 17 21:17:00 user nova-compute[72818]:     </disk>
Aug 17 21:17:00 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:17:00 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:00 user nova-compute[72818]:       <source dev="/dev/sde"/>
Aug 17 21:17:00 user nova-compute[72818]:       <target dev="vdc" bus="virtio"/>
Aug 17 21:17:00 user nova-compute[72818]:       <serial>6db0bd26-6a04-4259-aaa1-144cd0864d1e</serial>
Aug 17 21:17:00 user nova-compute[72818]:     </disk>
Aug 17 21:17:00 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:00 user nova-compute[72818]:       <mac address="fa:16:3e:81:e7:63"/>
Aug 17 21:17:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:00 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:00 user nova-compute[72818]:       <target dev="tapfd598161-5c"/>
Aug 17 21:17:00 user nova-compute[72818]:     </interface>
Aug 17 21:17:00 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:00 user nova-compute[72818]:       <mac address="fa:16:3e:aa:21:0a"/>
Aug 17 21:17:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:00 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:00 user nova-compute[72818]:       <target dev="tap8ceb5790-78"/>
Aug 17 21:17:00 user nova-compute[72818]:     </interface>
Aug 17 21:17:00 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:00 user nova-compute[72818]:       <mac address="fa:16:3e:d8:cf:24"/>
Aug 17 21:17:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:00 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:00 user nova-compute[72818]:       <target dev="tap1a5b3081-03"/>
Aug 17 21:17:00 user nova-compute[72818]:     </interface>
Aug 17 21:17:00 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:00 user nova-compute[72818]:       <mac address="fa:16:3e:7b:97:6f"/>
Aug 17 21:17:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:00 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:00 user nova-compute[72818]:       <target dev="tapfbc233f3-63"/>
Aug 17 21:17:00 user nova-compute[72818]:     </interface>
Aug 17 21:17:00 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:00 user nova-compute[72818]:       <mac address="fa:16:3e:d5:4a:63"/>
Aug 17 21:17:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:00 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:00 user nova-compute[72818]:       <target dev="tap4547ebf9-7d"/>
Aug 17 21:17:00 user nova-compute[72818]:     </interface>
Aug 17 21:17:00 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:00 user nova-compute[72818]:       <mac address="fa:16:3e:69:60:81"/>
Aug 17 21:17:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:00 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:00 user nova-compute[72818]:       <target dev="tap4f0c45d2-13"/>
Aug 17 21:17:00 user nova-compute[72818]:     </interface>
Aug 17 21:17:00 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:00 user nova-compute[72818]:       <mac address="fa:16:3e:5d:55:fd"/>
Aug 17 21:17:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:00 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:00 user nova-compute[72818]:       <target dev="tap428b6981-4f"/>
Aug 17 21:17:00 user nova-compute[72818]:     </interface>
Aug 17 21:17:00 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:17:00 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/a4618087-b551-4cc4-b50e-5276bb8395cd/console.log" append="off"/>
Aug 17 21:17:00 user nova-compute[72818]:     </serial>
Aug 17 21:17:00 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:17:00 user nova-compute[72818]:     <video>
Aug 17 21:17:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:00 user nova-compute[72818]:     </video>
Aug 17 21:17:00 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:17:00 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:17:00 user nova-compute[72818]:     </rng>
Aug 17 21:17:00 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:17:00 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:17:00 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:17:00 user nova-compute[72818]:     </memballoon>
Aug 17 21:17:00 user nova-compute[72818]:   </devices>
Aug 17 21:17:00 user nova-compute[72818]: </domain>
Aug 17 21:17:00 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:e7:63,bridge_name='br-int',has_traffic_filtering=True,id=fd598161-5c23-496b-a4bc-6014c311cede,network=Network(3c0386bc-b1c7-4730-a896-e935a72c6e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd598161-5c') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e7:63,bridge_name='br-int',has_traffic_filtering=True,id=fd598161-5c23-496b-a4bc-6014c311cede,network=Network(3c0386bc-b1c7-4730-a896-e935a72c6e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd598161-5c') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd598161-5c, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd598161-5c, col_values=(('external_ids', {'iface-id': 'fd598161-5c23-496b-a4bc-6014c311cede', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:e7:63', 'vm-uuid': 'a4618087-b551-4cc4-b50e-5276bb8395cd'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: INFO os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e7:63,bridge_name='br-int',has_traffic_filtering=True,id=fd598161-5c23-496b-a4bc-6014c311cede,network=Network(3c0386bc-b1c7-4730-a896-e935a72c6e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd598161-5c')
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:21:0a,bridge_name='br-int',has_traffic_filtering=True,id=8ceb5790-78d9-4df8-ac63-f5607672129a,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ceb5790-78') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:21:0a,bridge_name='br-int',has_traffic_filtering=True,id=8ceb5790-78d9-4df8-ac63-f5607672129a,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ceb5790-78') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ceb5790-78, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ceb5790-78, col_values=(('external_ids', {'iface-id': '8ceb5790-78d9-4df8-ac63-f5607672129a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:21:0a', 'vm-uuid': 'a4618087-b551-4cc4-b50e-5276bb8395cd'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: INFO os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:21:0a,bridge_name='br-int',has_traffic_filtering=True,id=8ceb5790-78d9-4df8-ac63-f5607672129a,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ceb5790-78')
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cf:24,bridge_name='br-int',has_traffic_filtering=True,id=1a5b3081-03b9-4b82-8470-5192e46ebad3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1a5b3081-03') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cf:24,bridge_name='br-int',has_traffic_filtering=True,id=1a5b3081-03b9-4b82-8470-5192e46ebad3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1a5b3081-03') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a5b3081-03, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a5b3081-03, col_values=(('external_ids', {'iface-id': '1a5b3081-03b9-4b82-8470-5192e46ebad3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:cf:24', 'vm-uuid': 'a4618087-b551-4cc4-b50e-5276bb8395cd'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.compute.manager [req-82cfb9e8-c46c-4e0c-9616-7074696ecab8 req-bc2931dc-0cc8-4a15-95d9-c9e809018950 service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Received event network-vif-unplugged-4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-82cfb9e8-c46c-4e0c-9616-7074696ecab8 req-bc2931dc-0cc8-4a15-95d9-c9e809018950 service nova] Acquiring lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-82cfb9e8-c46c-4e0c-9616-7074696ecab8 req-bc2931dc-0cc8-4a15-95d9-c9e809018950 service nova] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-82cfb9e8-c46c-4e0c-9616-7074696ecab8 req-bc2931dc-0cc8-4a15-95d9-c9e809018950 service nova] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.compute.manager [req-82cfb9e8-c46c-4e0c-9616-7074696ecab8 req-bc2931dc-0cc8-4a15-95d9-c9e809018950 service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] No waiting events found dispatching network-vif-unplugged-4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.compute.manager [req-82cfb9e8-c46c-4e0c-9616-7074696ecab8 req-bc2931dc-0cc8-4a15-95d9-c9e809018950 service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Received event network-vif-unplugged-4f9c960f-9da7-45e6-8244-3b3b5f205912 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: INFO os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cf:24,bridge_name='br-int',has_traffic_filtering=True,id=1a5b3081-03b9-4b82-8470-5192e46ebad3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1a5b3081-03')
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbc233f3-63c0-4529-aab0-fb00584462fb", "address": "fa:16:3e:7b:97:6f", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc233f3-63", "ovs_interfaceid": "fbc233f3-63c0-4529-aab0-fb00584462fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "fbc233f3-63c0-4529-aab0-fb00584462fb", "address": "fa:16:3e:7b:97:6f", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc233f3-63", "ovs_interfaceid": "fbc233f3-63c0-4529-aab0-fb00584462fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:97:6f,bridge_name='br-int',has_traffic_filtering=True,id=fbc233f3-63c0-4529-aab0-fb00584462fb,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc233f3-63') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:97:6f,bridge_name='br-int',has_traffic_filtering=True,id=fbc233f3-63c0-4529-aab0-fb00584462fb,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc233f3-63') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbc233f3-63, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfbc233f3-63, col_values=(('external_ids', {'iface-id': 'fbc233f3-63c0-4529-aab0-fb00584462fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:97:6f', 'vm-uuid': 'a4618087-b551-4cc4-b50e-5276bb8395cd'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: INFO os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:97:6f,bridge_name='br-int',has_traffic_filtering=True,id=fbc233f3-63c0-4529-aab0-fb00584462fb,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc233f3-63')
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:63,bridge_name='br-int',has_traffic_filtering=True,id=4547ebf9-7d38-4301-bf48-b7d0cbb109c3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4547ebf9-7d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:63,bridge_name='br-int',has_traffic_filtering=True,id=4547ebf9-7d38-4301-bf48-b7d0cbb109c3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4547ebf9-7d') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4547ebf9-7d, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4547ebf9-7d, col_values=(('external_ids', {'iface-id': '4547ebf9-7d38-4301-bf48-b7d0cbb109c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:4a:63', 'vm-uuid': 'a4618087-b551-4cc4-b50e-5276bb8395cd'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: INFO os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:63,bridge_name='br-int',has_traffic_filtering=True,id=4547ebf9-7d38-4301-bf48-b7d0cbb109c3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4547ebf9-7d')
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:60:81,bridge_name='br-int',has_traffic_filtering=True,id=4f0c45d2-1343-43b8-aadc-53b2229dacd0,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f0c45d2-13') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:60:81,bridge_name='br-int',has_traffic_filtering=True,id=4f0c45d2-1343-43b8-aadc-53b2229dacd0,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f0c45d2-13') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f0c45d2-13, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f0c45d2-13, col_values=(('external_ids', {'iface-id': '4f0c45d2-1343-43b8-aadc-53b2229dacd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:60:81', 'vm-uuid': 'a4618087-b551-4cc4-b50e-5276bb8395cd'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: INFO os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:60:81,bridge_name='br-int',has_traffic_filtering=True,id=4f0c45d2-1343-43b8-aadc-53b2229dacd0,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f0c45d2-13')
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "428b6981-4fb9-4aab-8966-44c4079c7764", "address": "fa:16:3e:5d:55:fd", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428b6981-4f", "ovs_interfaceid": "428b6981-4fb9-4aab-8966-44c4079c7764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "428b6981-4fb9-4aab-8966-44c4079c7764", "address": "fa:16:3e:5d:55:fd", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428b6981-4f", "ovs_interfaceid": "428b6981-4fb9-4aab-8966-44c4079c7764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:55:fd,bridge_name='br-int',has_traffic_filtering=True,id=428b6981-4fb9-4aab-8966-44c4079c7764,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428b6981-4f') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:55:fd,bridge_name='br-int',has_traffic_filtering=True,id=428b6981-4fb9-4aab-8966-44c4079c7764,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428b6981-4f') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap428b6981-4f, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap428b6981-4f, col_values=(('external_ids', {'iface-id': '428b6981-4fb9-4aab-8966-44c4079c7764', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:55:fd', 'vm-uuid': 'a4618087-b551-4cc4-b50e-5276bb8395cd'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: INFO os_vif [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:55:fd,bridge_name='br-int',has_traffic_filtering=True,id=428b6981-4fb9-4aab-8966-44c4079c7764,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428b6981-4f')
Aug 17 21:17:01 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Instance destroyed successfully.
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.objects.instance [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lazy-loading 'resources' on Instance uuid 32d5ecaa-f8b2-4181-9171-f0d78493ffb2 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1005601673',display_name='tempest-DeleteServersTestJSON-server-1005601673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1005601673',id=1,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eba6109d7274198ba4db4769b64a372',ramdisk_id='',reservation_id='r-i2n2vjm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-724394875',owner_user_name='tempest-DeleteServersTestJSON-724394875-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:15:04Z,user_data=None,user_id='c8f74b1cdf584477a52b270e474f7b4c',uuid=32d5ecaa-f8b2-4181-9171-f0d78493ffb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "address": "fa:16:3e:30:65:83", "network": {"id": "cf8d1111-fc56-453b-87fe-698e5d537fed", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1309064060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eba6109d7274198ba4db4769b64a372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9c960f-9d", "ovs_interfaceid": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Converting VIF {"id": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "address": "fa:16:3e:30:65:83", "network": {"id": "cf8d1111-fc56-453b-87fe-698e5d537fed", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1309064060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eba6109d7274198ba4db4769b64a372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9c960f-9d", "ovs_interfaceid": "4f9c960f-9da7-45e6-8244-3b3b5f205912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:65:83,bridge_name='br-int',has_traffic_filtering=True,id=4f9c960f-9da7-45e6-8244-3b3b5f205912,network=Network(cf8d1111-fc56-453b-87fe-698e5d537fed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9c960f-9d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_vif [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:65:83,bridge_name='br-int',has_traffic_filtering=True,id=4f9c960f-9da7-45e6-8244-3b3b5f205912,network=Network(cf8d1111-fc56-453b-87fe-698e5d537fed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9c960f-9d') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f9c960f-9d, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] No BDM found with device name hda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] No VIF found with MAC fa:16:3e:81:e7:63, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] No VIF found with MAC fa:16:3e:d5:4a:63, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:01 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Using config drive
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:01 user nova-compute[72818]: INFO os_vif [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:65:83,bridge_name='br-int',has_traffic_filtering=True,id=4f9c960f-9da7-45e6-8244-3b3b5f205912,network=Network(cf8d1111-fc56-453b-87fe-698e5d537fed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9c960f-9d')
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwCuUSrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:01 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe078b38-6b16-4016-bd6c-7a931d90cb51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:01 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Creating config drive at /opt/stack/data/nova/instances/a4618087-b551-4cc4-b50e-5276bb8395cd/disk.config
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a4618087-b551-4cc4-b50e-5276bb8395cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe8k7orcg {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2411ad5-b393-4911-8b10-425be0667a4e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:01 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:01 user nova-compute[72818]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 (non-flash)
Aug 17 21:17:01 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:01 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:01 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:01 user nova-compute[72818]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 (non-flash)
Aug 17 21:17:01 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:01 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f285935b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8'): ({'sdd'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Removing single pathed devices sdd {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a4618087-b551-4cc4-b50e-5276bb8395cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe8k7orcg" returned: 0 in 0.056s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3ce22f-5bbf-4c83-b08b-f676fe39a73a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3b05a2-5f51-428a-8b8a-d316731f9a4b]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Flushing IO for device /dev/sdd {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e00f683-32d2-4086-a7d2-65616d15cd99]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[086df6e2-2f80-4ad6-b0c2-e9e14c944787]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a2165-a400-4bc0-b5d8-6f23e66422bf]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0f1442-de9f-4117-8430-6728aadc4f1c]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8, portal: 172.16.0.220,3260]
Aug 17 21:17:01 user nova-compute[72818]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8, portal: 172.16.0.220,3260] successful.
Aug 17 21:17:01 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c72c23-a8dd-4497-ad05-7f6dade47ff8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5efbeb-e49d-44e5-825d-663679d70ecc]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] <== disconnect_volume: return (349ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:17:01 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Deleting instance files /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2_del
Aug 17 21:17:01 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Deletion of /opt/stack/data/nova/instances/32d5ecaa-f8b2-4181-9171-f0d78493ffb2_del complete
Aug 17 21:17:01 user nova-compute[72818]: INFO nova.compute.manager [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Took 1.41 seconds to destroy the instance on the hypervisor.
Aug 17 21:17:01 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:17:01 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:17:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-2963e90f-78e9-48d1-9fce-ac75afada824 req-f5ecb925-06e1-4fec-8e9f-ab919287fd3e service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Received event network-vif-plugged-4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2963e90f-78e9-48d1-9fce-ac75afada824 req-f5ecb925-06e1-4fec-8e9f-ab919287fd3e service nova] Acquiring lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2963e90f-78e9-48d1-9fce-ac75afada824 req-f5ecb925-06e1-4fec-8e9f-ab919287fd3e service nova] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2963e90f-78e9-48d1-9fce-ac75afada824 req-f5ecb925-06e1-4fec-8e9f-ab919287fd3e service nova] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-2963e90f-78e9-48d1-9fce-ac75afada824 req-f5ecb925-06e1-4fec-8e9f-ab919287fd3e service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] No waiting events found dispatching network-vif-plugged-4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:02 user nova-compute[72818]: WARNING nova.compute.manager [req-2963e90f-78e9-48d1-9fce-ac75afada824 req-f5ecb925-06e1-4fec-8e9f-ab919287fd3e service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Received unexpected event network-vif-plugged-4f9c960f-9da7-45e6-8244-3b3b5f205912 for instance with vm_state active and task_state deleting.
Aug 17 21:17:02 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:02 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Took 1.00 seconds to deallocate network for instance.
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:17:03 user nova-compute[72818]: INFO nova.compute.claims [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Claim successful on node user
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-d0532484-c8e8-43f9-ae94-4d138b52a5ca req-82e31f10-cf8c-4cfe-abde-f27215b1a734 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d0532484-c8e8-43f9-ae94-4d138b52a5ca req-82e31f10-cf8c-4cfe-abde-f27215b1a734 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d0532484-c8e8-43f9-ae94-4d138b52a5ca req-82e31f10-cf8c-4cfe-abde-f27215b1a734 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d0532484-c8e8-43f9-ae94-4d138b52a5ca req-82e31f10-cf8c-4cfe-abde-f27215b1a734 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-d0532484-c8e8-43f9-ae94-4d138b52a5ca req-82e31f10-cf8c-4cfe-abde-f27215b1a734 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:03 user nova-compute[72818]: WARNING nova.compute.manager [req-d0532484-c8e8-43f9-ae94-4d138b52a5ca req-82e31f10-cf8c-4cfe-abde-f27215b1a734 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-fd598161-5c23-496b-a4bc-6014c311cede for instance with vm_state building and task_state spawning.
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-81b6a0a1-d8f8-4a1b-a47c-4e4d821a429a req-1ce37889-0983-4be1-9236-2e96b958241b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-1a5b3081-03b9-4b82-8470-5192e46ebad3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-81b6a0a1-d8f8-4a1b-a47c-4e4d821a429a req-1ce37889-0983-4be1-9236-2e96b958241b service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-81b6a0a1-d8f8-4a1b-a47c-4e4d821a429a req-1ce37889-0983-4be1-9236-2e96b958241b service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-81b6a0a1-d8f8-4a1b-a47c-4e4d821a429a req-1ce37889-0983-4be1-9236-2e96b958241b service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-81b6a0a1-d8f8-4a1b-a47c-4e4d821a429a req-1ce37889-0983-4be1-9236-2e96b958241b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-1a5b3081-03b9-4b82-8470-5192e46ebad3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:04 user nova-compute[72818]: WARNING nova.compute.manager [req-81b6a0a1-d8f8-4a1b-a47c-4e4d821a429a req-1ce37889-0983-4be1-9236-2e96b958241b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-1a5b3081-03b9-4b82-8470-5192e46ebad3 for instance with vm_state building and task_state spawning.
Aug 17 21:17:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG nova.network.neutron [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:17:04 user nova-compute[72818]: INFO nova.compute.manager [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Took 1.28 seconds to detach 1 volumes for instance.
Aug 17 21:17:04 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:17:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG nova.policy [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '790700df1c8549699854d5a0aa6e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae77104eaa942eca3d579618e78ccc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:17:04 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Creating image(s)
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "/opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "/opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "/opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.233s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.015s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.202s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-55b9faf4-85f2-4038-9307-68b3eef6ad9b req-1045cc7a-08f7-4078-a28a-c8f2d3550df4 service nova] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Received event network-vif-deleted-4f9c960f-9da7-45e6-8244-3b3b5f205912 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk 1073741824" returned: 0 in 0.066s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.224s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.022s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:05 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Deleted allocations for instance 32d5ecaa-f8b2-4181-9171-f0d78493ffb2
Aug 17 21:17:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Cannot resize image /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.objects.instance [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lazy-loading 'migration_context' on Instance uuid 48b00603-33ea-4eaa-b445-934ba1ab88f4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Ensure instance console log exists: /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.network.neutron [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Successfully created port: b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44d8037d-f19e-4f32-8cea-5339a0435f60 tempest-DeleteServersTestJSON-724394875 tempest-DeleteServersTestJSON-724394875-project-member] Lock "32d5ecaa-f8b2-4181-9171-f0d78493ffb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.078s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:05 user nova-compute[72818]: WARNING nova.compute.manager [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-fd598161-5c23-496b-a4bc-6014c311cede for instance with vm_state building and task_state spawning.
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-8ceb5790-78d9-4df8-ac63-f5607672129a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-8ceb5790-78d9-4df8-ac63-f5607672129a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:05 user nova-compute[72818]: WARNING nova.compute.manager [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-8ceb5790-78d9-4df8-ac63-f5607672129a for instance with vm_state building and task_state spawning.
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-8ceb5790-78d9-4df8-ac63-f5607672129a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-8ceb5790-78d9-4df8-ac63-f5607672129a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:05 user nova-compute[72818]: WARNING nova.compute.manager [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-8ceb5790-78d9-4df8-ac63-f5607672129a for instance with vm_state building and task_state spawning.
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:05 user nova-compute[72818]: WARNING nova.compute.manager [req-a7182ef4-3769-459e-a0c0-2ddcf3d6a369 req-3be9ff24-ea0a-4877-800f-1046a48072c2 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-fbc233f3-63c0-4529-aab0-fb00584462fb for instance with vm_state building and task_state spawning.
Aug 17 21:17:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-1a5b3081-03b9-4b82-8470-5192e46ebad3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-1a5b3081-03b9-4b82-8470-5192e46ebad3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:06 user nova-compute[72818]: WARNING nova.compute.manager [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-1a5b3081-03b9-4b82-8470-5192e46ebad3 for instance with vm_state building and task_state spawning.
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:06 user nova-compute[72818]: WARNING nova.compute.manager [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-4f0c45d2-1343-43b8-aadc-53b2229dacd0 for instance with vm_state building and task_state spawning.
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:06 user nova-compute[72818]: WARNING nova.compute.manager [req-f3e0eef3-0c75-48ef-93da-e2c22e6422fc req-d1ff64b1-f332-4eef-b1f4-4fcd5c7fc396 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-4f0c45d2-1343-43b8-aadc-53b2229dacd0 for instance with vm_state building and task_state spawning.
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.network.neutron [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Successfully updated port: b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquired lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.network.neutron [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.network.neutron [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.network.neutron [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Updating instance_info_cache with network_info: [{"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Releasing lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Instance network_info: |[{"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Start _get_guest_xml network_info=[{"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:17:06 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:17:06 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1398987713',display_name='tempest-TestStampPattern-server-1398987713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1398987713',id=10,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOg12rwG0goFcEOqfjeVkLRdQHA4VYmkHTOdp9mo/FLMqnHH8awtzuou6HfZ30eiO4Lj+EDhkp42MExzTbcAj8c21NG1Hgsi9ewpnMwejZ3D3SuTfwK1a/C6Q0zNej4H8Q==',key_name='tempest-TestStampPattern-158492147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ae77104eaa942eca3d579618e78ccc9',ramdisk_id='',reservation_id='r-qzbcclig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1752250551',owner_user_name='tempest-TestStampPattern-1752250551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:17:04Z,user_data=None,user_id='790700df1c8549699854d5a0aa6e5566',uuid=48b00603-33ea-4eaa-b445-934ba1ab88f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Converting VIF {"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:44:93,bridge_name='br-int',has_traffic_filtering=True,id=b1871d19-ffff-4ade-99b9-9e0355b5120a,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1871d19-ff') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.objects.instance [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lazy-loading 'pci_devices' on Instance uuid 48b00603-33ea-4eaa-b445-934ba1ab88f4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:17:06 user nova-compute[72818]:   <uuid>48b00603-33ea-4eaa-b445-934ba1ab88f4</uuid>
Aug 17 21:17:06 user nova-compute[72818]:   <name>instance-0000000a</name>
Aug 17 21:17:06 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:17:06 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:17:06 user nova-compute[72818]:   <metadata>
Aug 17 21:17:06 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:17:06 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:17:06 user nova-compute[72818]:       <nova:name>tempest-TestStampPattern-server-1398987713</nova:name>
Aug 17 21:17:06 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:17:06</nova:creationTime>
Aug 17 21:17:06 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:17:06 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:17:06 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:17:06 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:17:06 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:17:06 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:17:06 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:17:06 user nova-compute[72818]:       <nova:owner>
Aug 17 21:17:06 user nova-compute[72818]:         <nova:user uuid="790700df1c8549699854d5a0aa6e5566">tempest-TestStampPattern-1752250551-project-member</nova:user>
Aug 17 21:17:06 user nova-compute[72818]:         <nova:project uuid="0ae77104eaa942eca3d579618e78ccc9">tempest-TestStampPattern-1752250551</nova:project>
Aug 17 21:17:06 user nova-compute[72818]:       </nova:owner>
Aug 17 21:17:06 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:17:06 user nova-compute[72818]:       <nova:ports>
Aug 17 21:17:06 user nova-compute[72818]:         <nova:port uuid="b1871d19-ffff-4ade-99b9-9e0355b5120a">
Aug 17 21:17:06 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 21:17:06 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:06 user nova-compute[72818]:       </nova:ports>
Aug 17 21:17:06 user nova-compute[72818]:     </nova:instance>
Aug 17 21:17:06 user nova-compute[72818]:   </metadata>
Aug 17 21:17:06 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:17:06 user nova-compute[72818]:     <system>
Aug 17 21:17:06 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:17:06 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:17:06 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:17:06 user nova-compute[72818]:       <entry name="serial">48b00603-33ea-4eaa-b445-934ba1ab88f4</entry>
Aug 17 21:17:06 user nova-compute[72818]:       <entry name="uuid">48b00603-33ea-4eaa-b445-934ba1ab88f4</entry>
Aug 17 21:17:06 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:17:06 user nova-compute[72818]:     </system>
Aug 17 21:17:06 user nova-compute[72818]:   </sysinfo>
Aug 17 21:17:06 user nova-compute[72818]:   <os>
Aug 17 21:17:06 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:17:06 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:17:06 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:17:06 user nova-compute[72818]:   </os>
Aug 17 21:17:06 user nova-compute[72818]:   <features>
Aug 17 21:17:06 user nova-compute[72818]:     <acpi/>
Aug 17 21:17:06 user nova-compute[72818]:     <apic/>
Aug 17 21:17:06 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:17:06 user nova-compute[72818]:   </features>
Aug 17 21:17:06 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:17:06 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:17:06 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:17:06 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:17:06 user nova-compute[72818]:   </clock>
Aug 17 21:17:06 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:17:06 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:17:06 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:17:06 user nova-compute[72818]:   </cpu>
Aug 17 21:17:06 user nova-compute[72818]:   <devices>
Aug 17 21:17:06 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:17:06 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:17:06 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk"/>
Aug 17 21:17:06 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:17:06 user nova-compute[72818]:     </disk>
Aug 17 21:17:06 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:06 user nova-compute[72818]:       <mac address="fa:16:3e:97:44:93"/>
Aug 17 21:17:06 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:06 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:06 user nova-compute[72818]:       <target dev="tapb1871d19-ff"/>
Aug 17 21:17:06 user nova-compute[72818]:     </interface>
Aug 17 21:17:06 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:17:06 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/console.log" append="off"/>
Aug 17 21:17:06 user nova-compute[72818]:     </serial>
Aug 17 21:17:06 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:17:06 user nova-compute[72818]:     <video>
Aug 17 21:17:06 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:06 user nova-compute[72818]:     </video>
Aug 17 21:17:06 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:17:06 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:17:06 user nova-compute[72818]:     </rng>
Aug 17 21:17:06 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:17:06 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:17:06 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:17:06 user nova-compute[72818]:     </memballoon>
Aug 17 21:17:06 user nova-compute[72818]:   </devices>
Aug 17 21:17:06 user nova-compute[72818]: </domain>
Aug 17 21:17:06 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1398987713',display_name='tempest-TestStampPattern-server-1398987713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1398987713',id=10,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOg12rwG0goFcEOqfjeVkLRdQHA4VYmkHTOdp9mo/FLMqnHH8awtzuou6HfZ30eiO4Lj+EDhkp42MExzTbcAj8c21NG1Hgsi9ewpnMwejZ3D3SuTfwK1a/C6Q0zNej4H8Q==',key_name='tempest-TestStampPattern-158492147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ae77104eaa942eca3d579618e78ccc9',ramdisk_id='',reservation_id='r-qzbcclig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1752250551',owner_user_name='tempest-TestStampPattern-1752250551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:17:04Z,user_data=None,user_id='790700df1c8549699854d5a0aa6e5566',uuid=48b00603-33ea-4eaa-b445-934ba1ab88f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Converting VIF {"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:44:93,bridge_name='br-int',has_traffic_filtering=True,id=b1871d19-ffff-4ade-99b9-9e0355b5120a,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1871d19-ff') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG os_vif [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:44:93,bridge_name='br-int',has_traffic_filtering=True,id=b1871d19-ffff-4ade-99b9-9e0355b5120a,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1871d19-ff') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1871d19-ff, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1871d19-ff, col_values=(('external_ids', {'iface-id': 'b1871d19-ffff-4ade-99b9-9e0355b5120a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:44:93', 'vm-uuid': '48b00603-33ea-4eaa-b445-934ba1ab88f4'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:06 user nova-compute[72818]: INFO os_vif [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:44:93,bridge_name='br-int',has_traffic_filtering=True,id=b1871d19-ffff-4ade-99b9-9e0355b5120a,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1871d19-ff')
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] No VIF found with MAC fa:16:3e:97:44:93, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-3014cbdf-5e76-44c8-a149-5be67f10d56a req-45ed8445-ac12-40b0-9091-608bc0e4dc69 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Received event network-changed-b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-3014cbdf-5e76-44c8-a149-5be67f10d56a req-45ed8445-ac12-40b0-9091-608bc0e4dc69 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Refreshing instance network info cache due to event network-changed-b1871d19-ffff-4ade-99b9-9e0355b5120a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3014cbdf-5e76-44c8-a149-5be67f10d56a req-45ed8445-ac12-40b0-9091-608bc0e4dc69 service nova] Acquiring lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3014cbdf-5e76-44c8-a149-5be67f10d56a req-45ed8445-ac12-40b0-9091-608bc0e4dc69 service nova] Acquired lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.network.neutron [req-3014cbdf-5e76-44c8-a149-5be67f10d56a req-45ed8445-ac12-40b0-9091-608bc0e4dc69 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Refreshing network info cache for port b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:17:07 user nova-compute[72818]: INFO nova.virt.block_device [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Booting with volume 5515ad1e-fe92-498d-95f4-3f7bf824d51a at /dev/vdc
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.network.neutron [req-3014cbdf-5e76-44c8-a149-5be67f10d56a req-45ed8445-ac12-40b0-9091-608bc0e4dc69 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Updated VIF entry in instance network info cache for port b1871d19-ffff-4ade-99b9-9e0355b5120a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.network.neutron [req-3014cbdf-5e76-44c8-a149-5be67f10d56a req-45ed8445-ac12-40b0-9091-608bc0e4dc69 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Updating instance_info_cache with network_info: [{"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3014cbdf-5e76-44c8-a149-5be67f10d56a req-45ed8445-ac12-40b0-9091-608bc0e4dc69 service nova] Releasing lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG os_brick.utils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6253a9-c762-4d74-b511-1cc3d1bd3cac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53fc4a2-01a1-4b84-9275-4aec5370068a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f66f0dc-fd54-4abe-ba0c-b83d362cd42c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[727d57de-7caa-4a21-8cf7-0780203e4ba0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:07 user nova-compute[72818]: WARNING nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-fbc233f3-63c0-4529-aab0-fb00584462fb for instance with vm_state building and task_state spawning.
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:07 user nova-compute[72818]: WARNING nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 for instance with vm_state building and task_state spawning.
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:07 user nova-compute[72818]: WARNING nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 for instance with vm_state building and task_state spawning.
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:07 user nova-compute[72818]: WARNING nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-428b6981-4fb9-4aab-8966-44c4079c7764 for instance with vm_state building and task_state spawning.
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:07 user nova-compute[72818]: WARNING nova.compute.manager [req-9da74cb8-a6c8-4301-95d1-d20ce6e1e0a8 req-655c8ecf-4ddc-4f18-afed-cc702b5f441d service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-428b6981-4fb9-4aab-8966-44c4079c7764 for instance with vm_state building and task_state spawning.
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:07 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:17:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efff4b4-ae1e-447b-b28f-fb8b26447d7e]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG os_brick.utils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating existing volume attachment record: 37be072a-2e05-43f1-ae5f-2929fde636ea {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307027.812072, a4618087-b551-4cc4-b50e-5276bb8395cd => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:17:07 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] VM Resumed (Lifecycle Event)
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:17:07 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Instance spawned successfully.
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:17:07 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307027.8135455, a4618087-b551-4cc4-b50e-5276bb8395cd => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:17:07 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] VM Started (Lifecycle Event)
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:17:07 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:17:07 user nova-compute[72818]: INFO nova.compute.manager [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Took 12.88 seconds to spawn the instance on the hypervisor.
Aug 17 21:17:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:17:08 user nova-compute[72818]: INFO nova.compute.manager [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Took 53.82 seconds to build instance.
Aug 17 21:17:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9d9cc8dd-2282-467c-a3d8-02cffdde358c tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.926s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-8587cdb9-914d-418e-8592-4609d54de4b2 req-5e3bbfef-4987-4ac7-b2c3-65f72a2cc112 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Received event network-vif-plugged-b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8587cdb9-914d-418e-8592-4609d54de4b2 req-5e3bbfef-4987-4ac7-b2c3-65f72a2cc112 service nova] Acquiring lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8587cdb9-914d-418e-8592-4609d54de4b2 req-5e3bbfef-4987-4ac7-b2c3-65f72a2cc112 service nova] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8587cdb9-914d-418e-8592-4609d54de4b2 req-5e3bbfef-4987-4ac7-b2c3-65f72a2cc112 service nova] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-8587cdb9-914d-418e-8592-4609d54de4b2 req-5e3bbfef-4987-4ac7-b2c3-65f72a2cc112 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] No waiting events found dispatching network-vif-plugged-b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:09 user nova-compute[72818]: WARNING nova.compute.manager [req-8587cdb9-914d-418e-8592-4609d54de4b2 req-5e3bbfef-4987-4ac7-b2c3-65f72a2cc112 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Received unexpected event network-vif-plugged-b1871d19-ffff-4ade-99b9-9e0355b5120a for instance with vm_state building and task_state spawning.
Aug 17 21:17:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-8587cdb9-914d-418e-8592-4609d54de4b2 req-5e3bbfef-4987-4ac7-b2c3-65f72a2cc112 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Received event network-vif-plugged-b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8587cdb9-914d-418e-8592-4609d54de4b2 req-5e3bbfef-4987-4ac7-b2c3-65f72a2cc112 service nova] Acquiring lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8587cdb9-914d-418e-8592-4609d54de4b2 req-5e3bbfef-4987-4ac7-b2c3-65f72a2cc112 service nova] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8587cdb9-914d-418e-8592-4609d54de4b2 req-5e3bbfef-4987-4ac7-b2c3-65f72a2cc112 service nova] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-8587cdb9-914d-418e-8592-4609d54de4b2 req-5e3bbfef-4987-4ac7-b2c3-65f72a2cc112 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] No waiting events found dispatching network-vif-plugged-b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:09 user nova-compute[72818]: WARNING nova.compute.manager [req-8587cdb9-914d-418e-8592-4609d54de4b2 req-5e3bbfef-4987-4ac7-b2c3-65f72a2cc112 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Received unexpected event network-vif-plugged-b1871d19-ffff-4ade-99b9-9e0355b5120a for instance with vm_state building and task_state spawning.
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307030.5452802, 48b00603-33ea-4eaa-b445-934ba1ab88f4 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:17:10 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] VM Resumed (Lifecycle Event)
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:17:10 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Instance spawned successfully.
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:10 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307030.5476346, 48b00603-33ea-4eaa-b445-934ba1ab88f4 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:17:10 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] VM Started (Lifecycle Event)
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:17:10 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:17:10 user nova-compute[72818]: INFO nova.compute.manager [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Took 6.15 seconds to spawn the instance on the hypervisor.
Aug 17 21:17:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:17:10 user nova-compute[72818]: INFO nova.compute.manager [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Took 7.27 seconds to build instance.
Aug 17 21:17:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-46296f0a-cb06-4882-be9e-3563033c0648 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.405s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-f935d8cd-30f8-4a56-94ed-1703825fd2b2 req-a02013ce-acb7-42bb-ade8-dd7d57f36100 service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Received event network-changed-e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-f935d8cd-30f8-4a56-94ed-1703825fd2b2 req-a02013ce-acb7-42bb-ade8-dd7d57f36100 service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Refreshing instance network info cache due to event network-changed-e94f410f-1593-4c05-ae40-a8c34f12c210. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:17:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f935d8cd-30f8-4a56-94ed-1703825fd2b2 req-a02013ce-acb7-42bb-ade8-dd7d57f36100 service nova] Acquiring lock "refresh_cache-b93c6b2f-59ee-4e7f-9805-97ef627eccdb" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f935d8cd-30f8-4a56-94ed-1703825fd2b2 req-a02013ce-acb7-42bb-ade8-dd7d57f36100 service nova] Acquired lock "refresh_cache-b93c6b2f-59ee-4e7f-9805-97ef627eccdb" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:14 user nova-compute[72818]: DEBUG nova.network.neutron [req-f935d8cd-30f8-4a56-94ed-1703825fd2b2 req-a02013ce-acb7-42bb-ade8-dd7d57f36100 service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Refreshing network info cache for port e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:17:15 user nova-compute[72818]: DEBUG nova.network.neutron [req-f935d8cd-30f8-4a56-94ed-1703825fd2b2 req-a02013ce-acb7-42bb-ade8-dd7d57f36100 service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Updated VIF entry in instance network info cache for port e94f410f-1593-4c05-ae40-a8c34f12c210. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:17:15 user nova-compute[72818]: DEBUG nova.network.neutron [req-f935d8cd-30f8-4a56-94ed-1703825fd2b2 req-a02013ce-acb7-42bb-ade8-dd7d57f36100 service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Updating instance_info_cache with network_info: [{"id": "e94f410f-1593-4c05-ae40-a8c34f12c210", "address": "fa:16:3e:69:af:13", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94f410f-15", "ovs_interfaceid": "e94f410f-1593-4c05-ae40-a8c34f12c210", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f935d8cd-30f8-4a56-94ed-1703825fd2b2 req-a02013ce-acb7-42bb-ade8-dd7d57f36100 service nova] Releasing lock "refresh_cache-b93c6b2f-59ee-4e7f-9805-97ef627eccdb" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:16 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307021.349583, 32d5ecaa-f8b2-4181-9171-f0d78493ffb2 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:17:16 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] VM Stopped (Lifecycle Event)
Aug 17 21:17:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-782be915-8503-4c9d-93fe-edd38d360a80 None None] [instance: 32d5ecaa-f8b2-4181-9171-f0d78493ffb2] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:17:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG nova.objects.instance [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lazy-loading 'flavor' on Instance uuid b93c6b2f-59ee-4e7f-9805-97ef627eccdb {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-4d9ec1c8-2eaa-473e-b855-7438741c2778 req-428603a5-1e70-402b-9898-2de18afc6af6 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-changed-5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-4d9ec1c8-2eaa-473e-b855-7438741c2778 req-428603a5-1e70-402b-9898-2de18afc6af6 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Refreshing instance network info cache due to event network-changed-5e1c71f4-af86-4f7a-8dcf-0210699e469b. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4d9ec1c8-2eaa-473e-b855-7438741c2778 req-428603a5-1e70-402b-9898-2de18afc6af6 service nova] Acquiring lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4d9ec1c8-2eaa-473e-b855-7438741c2778 req-428603a5-1e70-402b-9898-2de18afc6af6 service nova] Acquired lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG nova.network.neutron [req-4d9ec1c8-2eaa-473e-b855-7438741c2778 req-428603a5-1e70-402b-9898-2de18afc6af6 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Refreshing network info cache for port 5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:20 user nova-compute[72818]: INFO nova.compute.manager [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Attaching volume 68084487-5b53-4ac7-b805-96652c359659 to /dev/vdb
Aug 17 21:17:20 user nova-compute[72818]: DEBUG os_brick.utils [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d881579-a1c3-4853-9973-e0ba4eaf4959]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4ef839-d518-4813-9890-e19a41461641]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b2872e-ad0b-4eb0-98eb-c63fc0e1c3d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fff3be-532c-4331-b478-7ca47b73d692]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:20 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:17:20 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[574f1580-f367-4f50-8608-7de15519534a]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG os_brick.utils [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:20 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Updating existing volume attachment record: 4c93227f-2ef8-4f7a-a665-a473e51db95c {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-6963e5a4-a722-4c24-b953-aeba7aaaa69e req-41fd7e6a-c1a7-42db-9e8e-5180eccdaf4b service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Received event network-changed-5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-6963e5a4-a722-4c24-b953-aeba7aaaa69e req-41fd7e6a-c1a7-42db-9e8e-5180eccdaf4b service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Refreshing instance network info cache due to event network-changed-5f2bc52b-9615-4568-a036-e17444ab271c. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6963e5a4-a722-4c24-b953-aeba7aaaa69e req-41fd7e6a-c1a7-42db-9e8e-5180eccdaf4b service nova] Acquiring lock "refresh_cache-3ab89c6a-9eae-4091-b8ab-320f1544d6b9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6963e5a4-a722-4c24-b953-aeba7aaaa69e req-41fd7e6a-c1a7-42db-9e8e-5180eccdaf4b service nova] Acquired lock "refresh_cache-3ab89c6a-9eae-4091-b8ab-320f1544d6b9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.network.neutron [req-6963e5a4-a722-4c24-b953-aeba7aaaa69e req-41fd7e6a-c1a7-42db-9e8e-5180eccdaf4b service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Refreshing network info cache for port 5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Acquiring lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lazy-loading 'flavor' on Instance uuid 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "interface-796d2c15-1728-4cd2-a325-e9385556050f-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "interface-796d2c15-1728-4cd2-a325-e9385556050f-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.objects.instance [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lazy-loading 'flavor' on Instance uuid 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.network.neutron [req-4d9ec1c8-2eaa-473e-b855-7438741c2778 req-428603a5-1e70-402b-9898-2de18afc6af6 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updated VIF entry in instance network info cache for port 5e1c71f4-af86-4f7a-8dcf-0210699e469b. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.network.neutron [req-4d9ec1c8-2eaa-473e-b855-7438741c2778 req-428603a5-1e70-402b-9898-2de18afc6af6 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updating instance_info_cache with network_info: [{"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4d9ec1c8-2eaa-473e-b855-7438741c2778 req-428603a5-1e70-402b-9898-2de18afc6af6 service nova] Releasing lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.207s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:17:21 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Creating image(s)
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Ensure instance console log exists: /opt/stack/data/nova/instances/279a0c9c-91a3-4c5b-8918-b1a9278b59ac/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Start _get_guest_xml network_info=[{"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "address": "fa:16:3e:9b:c5:5d", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b783d7f-a2", "ovs_interfaceid": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '91fa70d5-41fe-486f-bae5-680da2293388', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OldqEaRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '279a0c9c-91a3-4c5b-8918-b1a9278b59ac', 'attached_at': '', 'detached_at': '', 'volume_id': 'be2f0d88-dc09-4a49-8c8c-bde11b1a157a', 'serial': 'be2f0d88-dc09-4a49-8c8c-bde11b1a157a'}, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 1, 'attachment_id': '50acf1f3-8684-4875-9d33-671b2c7c032b', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGaOEduS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '279a0c9c-91a3-4c5b-8918-b1a9278b59ac', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba0c56f6-aaef-4f42-8704-f37701694b3b', 'serial': 'ba0c56f6-aaef-4f42-8704-f37701694b3b'}, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 2, 'attachment_id': '37be072a-2e05-43f1-ae5f-2929fde636ea', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBLqHMxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '279a0c9c-91a3-4c5b-8918-b1a9278b59ac', 'attached_at': '', 'detached_at': '', 'volume_id': '5515ad1e-fe92-498d-95f4-3f7bf824d51a', 'serial': '5515ad1e-fe92-498d-95f4-3f7bf824d51a'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:17:21 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:17:21 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OldqEaRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:21 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:21 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:21 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3514b1-4394-4163-b91e-1de160ce82cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:17:21 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[648ee7bc-c1fd-4722-8932-4c04095c5306]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a] added
Aug 17 21:17:21 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcd3576-7756-4931-b21e-2ed9cea769cc]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Acquiring lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:21 user nova-compute[72818]: INFO nova.compute.manager [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Attaching volume b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd to /dev/vdb
Aug 17 21:17:22 user nova-compute[72818]: DEBUG nova.objects.instance [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lazy-loading 'pci_requests' on Instance uuid 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.170s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85ebbb2-0fc3-4493-b96a-8c2f87019975]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG nova.network.neutron [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OldqEaRS {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OldqEaRS" returned: 0 in 0.069s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[540af84c-7c5d-4b61-b52b-942b006db9b2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OldqEaRS'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.utils [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fc884c-beb1-43b9-9b90-01c0f8a4f6d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.032s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b47351c-180d-4401-99f1-13daf3d98aa9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.138s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c79422-73cb-4540-8d58-e4415a403007]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[697b9143-d0b9-4e5e-8793-a833667aa331]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[be93c5ff-970f-4a34-a2d0-3e35da4e9352]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG nova.network.neutron [req-6963e5a4-a722-4c24-b953-aeba7aaaa69e req-41fd7e6a-c1a7-42db-9e8e-5180eccdaf4b service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Updated VIF entry in instance network info cache for port 5f2bc52b-9615-4568-a036-e17444ab271c. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG nova.network.neutron [req-6963e5a4-a722-4c24-b953-aeba7aaaa69e req-41fd7e6a-c1a7-42db-9e8e-5180eccdaf4b service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Updating instance_info_cache with network_info: [{"id": "5f2bc52b-9615-4568-a036-e17444ab271c", "address": "fa:16:3e:fa:ed:ba", "network": {"id": "a856cd30-6b1d-400d-82a6-051a5cb7391d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-375405083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e9f794f16e495787e5e4c98ae3e527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2bc52b-96", "ovs_interfaceid": "5f2bc52b-9615-4568-a036-e17444ab271c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a558923-b783-47b9-96e8-3e88c39df3b5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG nova.policy [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e7e96b636034002b8994454bc89fdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d5f3696b24e6a8c96af89e7316ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:22 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:22 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:22 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:22 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-badc31b4-5a4b-4ffe-8503-4499f23a6334 req-33976309-e877-42a8-b644-c4df0e3ade7a service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Received event network-changed-a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-badc31b4-5a4b-4ffe-8503-4499f23a6334 req-33976309-e877-42a8-b644-c4df0e3ade7a service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Refreshing instance network info cache due to event network-changed-a4e87f77-2469-4b69-b84c-0f41266d2467. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-badc31b4-5a4b-4ffe-8503-4499f23a6334 req-33976309-e877-42a8-b644-c4df0e3ade7a service nova] Acquiring lock "refresh_cache-e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-badc31b4-5a4b-4ffe-8503-4499f23a6334 req-33976309-e877-42a8-b644-c4df0e3ade7a service nova] Acquired lock "refresh_cache-e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG nova.network.neutron [req-badc31b4-5a4b-4ffe-8503-4499f23a6334 req-33976309-e877-42a8-b644-c4df0e3ade7a service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Refreshing network info cache for port a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6963e5a4-a722-4c24-b953-aeba7aaaa69e req-41fd7e6a-c1a7-42db-9e8e-5180eccdaf4b service nova] Releasing lock "refresh_cache-3ab89c6a-9eae-4091-b8ab-320f1544d6b9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:22 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d088aa7d-b318-4e20-b9ad-de1b19d441d5]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.utils [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] <== get_connector_properties: return (235ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Updating existing volume attachment record: 97ec61d4-5573-4b5c-a41c-ca57e980b069 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[86436b08-917c-4873-95d3-1c612d5f2506]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a, portal: 172.16.0.220,3260]
Aug 17 21:17:22 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a, portal: 172.16.0.220,3260] successful.
Aug 17 21:17:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a156447-3d7f-4583-bc5e-b625d0d70c3a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8770b6-7697-42b3-9fec-05a268980904]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:22 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:22 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:22 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:22 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:22 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:22 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.788s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] HCTL ('35', '-', '-', 0) found on session 6 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7761068-3826-4a1a-b617-179278edc7fb]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Searching for a device in session 6 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:17:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OldqEaRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG nova.network.neutron [req-badc31b4-5a4b-4ffe-8503-4499f23a6334 req-33976309-e877-42a8-b644-c4df0e3ade7a service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Updated VIF entry in instance network info cache for port a4e87f77-2469-4b69-b84c-0f41266d2467. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG nova.network.neutron [req-badc31b4-5a4b-4ffe-8503-4499f23a6334 req-33976309-e877-42a8-b644-c4df0e3ade7a service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Updating instance_info_cache with network_info: [{"id": "a4e87f77-2469-4b69-b84c-0f41266d2467", "address": "fa:16:3e:8d:f2:92", "network": {"id": "cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2066928365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0766e71864a4109b58d68e3eec4c67d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4e87f77-24", "ovs_interfaceid": "a4e87f77-2469-4b69-b84c-0f41266d2467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-badc31b4-5a4b-4ffe-8503-4499f23a6334 req-33976309-e877-42a8-b644-c4df0e3ade7a service nova] Releasing lock "refresh_cache-e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.829s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] <== connect_volume: return (1831ms) {'type': 'block', 'scsi_wwn': '23963393737656463', 'path': '/dev/sdd'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963393737656463', 'path': '/dev/sdd'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGaOEduS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:23 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:23 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:23 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbd308b-80b5-44ab-b1d2-da787caa79bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:17:23 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a173e54-d190-404b-87f7-21836a64a75b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b] added
Aug 17 21:17:23 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e07df8-eea9-4f6f-97af-c91f2d871c5e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4ab6f8-aef9-43da-bd72-9fd0dda893d5]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IGaOEduS {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IGaOEduS" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42fa394-d661-4172-85a3-788b885cb488]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IGaOEduS'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[140a86da-9565-4ef8-8421-6db60b4075bc]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d20df9d-629b-4071-b3ca-3e05175d35db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:23 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:23 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:23 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:23 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:23 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:23 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:23 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:23 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eca9f3-25c0-4fd3-b63f-996337c19531]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b, portal: 172.16.0.220,3260]
Aug 17 21:17:24 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b, portal: 172.16.0.220,3260] successful.
Aug 17 21:17:24 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d144878-3d4d-40f8-bdb8-0264ccc420ed]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63f8c8f-b9c7-4c1c-b1e6-6f83f20e42c4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:24 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:24 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:24 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:24 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:24 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:24 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:24 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:24 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:24 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:24 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0cbf1c-6e65-4bb9-831b-21a20961d11d]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGaOEduS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Successfully created port: d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-4dffe538-00c5-487e-9b9f-3f95e6947592 req-489e5d2f-bac2-48e6-a960-c155e8dca72d service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Received event network-changed-f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-4dffe538-00c5-487e-9b9f-3f95e6947592 req-489e5d2f-bac2-48e6-a960-c155e8dca72d service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Refreshing instance network info cache due to event network-changed-f445d362-0f87-4071-82f6-8ea4c42fbb4f. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4dffe538-00c5-487e-9b9f-3f95e6947592 req-489e5d2f-bac2-48e6-a960-c155e8dca72d service nova] Acquiring lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4dffe538-00c5-487e-9b9f-3f95e6947592 req-489e5d2f-bac2-48e6-a960-c155e8dca72d service nova] Acquired lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:24 user nova-compute[72818]: DEBUG nova.network.neutron [req-4dffe538-00c5-487e-9b9f-3f95e6947592 req-489e5d2f-bac2-48e6-a960-c155e8dca72d service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Refreshing network info cache for port f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '26166646663663831', 'path': '/dev/sdf'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166646663663831', 'path': '/dev/sdf'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBLqHMxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:25 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:25 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:25 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9109f18c-b337-4067-a964-c6ea9f56e53b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:17:25 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49f7b26-4e0e-47ff-ad37-1c84142dc2fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a] added
Aug 17 21:17:25 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[816d5779-0950-46b7-a670-61f2b100289c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39e4170-5e55-4393-b310-2fe612e9bf26]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UBLqHMxt {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UBLqHMxt" returned: 0 in 0.038s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbfdef7-7b98-4324-8dc4-0ff08dd06392]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UBLqHMxt'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7912ae2-09c6-4d99-a7a1-97504b44bbd5]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG nova.objects.instance [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lazy-loading 'flavor' on Instance uuid 01fcc357-dc4c-4215-b3a5-b9cea51ed532 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf6e091-c260-4d95-bf5c-30b0a2233622]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:25 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:25 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:25 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:25 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:25 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:25 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:25 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:25 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:25 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:25 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:25 user nova-compute[72818]: INFO nova.compute.manager [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Attaching volume 24964e89-33fc-4294-8db4-9db93143d744 to /dev/vdb
Aug 17 21:17:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.utils [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7e7f1c-07d6-4c08-b571-723f90211fe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7300d06f-e395-473f-b367-db638a3e4bbf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd4e9ad-ff43-4ffe-8a8c-de5d6205aa25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[91018689-67f0-4c29-9442-e067be07120a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:26 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cbaf92-94c6-4348-8f50-314584d57bb9]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Successfully updated port: d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.utils [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Updating existing volume attachment record: 04293bfd-c1d1-4a23-980a-7bbaee4e94f9 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquired lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-4dffe538-00c5-487e-9b9f-3f95e6947592 req-489e5d2f-bac2-48e6-a960-c155e8dca72d service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Updated VIF entry in instance network info cache for port f445d362-0f87-4071-82f6-8ea4c42fbb4f. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-4dffe538-00c5-487e-9b9f-3f95e6947592 req-489e5d2f-bac2-48e6-a960-c155e8dca72d service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Updating instance_info_cache with network_info: [{"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4dffe538-00c5-487e-9b9f-3f95e6947592 req-489e5d2f-bac2-48e6-a960-c155e8dca72d service nova] Releasing lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --login" returned: 0 in 1.089s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3a8d9b-7e29-4374-82e2-f925a08f9306]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a, portal: 172.16.0.220,3260]
Aug 17 21:17:26 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a, portal: 172.16.0.220,3260] successful.
Aug 17 21:17:26 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ee19ac-0a31-4a52-b7b5-a4f08a3beb37]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd95f99-3eec-46f4-a82f-8b8b2135388d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:26 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:26 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:26 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:26 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:26 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:26 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:26 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:26 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:26 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:26 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:26 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:26 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.397s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2c23b1-3d96-44a3-9c1d-06175a6fcc23]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-184b9120-23ae-4c5d-8723-54258b97304e req-60ddee6f-3b0b-4d8b-8264-8fc2dd0a0827 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-changed-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-184b9120-23ae-4c5d-8723-54258b97304e req-60ddee6f-3b0b-4d8b-8264-8fc2dd0a0827 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Refreshing instance network info cache due to event network-changed-d1fd1d06-a240-4248-bcbd-4ece6691d8a0. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:17:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-184b9120-23ae-4c5d-8723-54258b97304e req-60ddee6f-3b0b-4d8b-8264-8fc2dd0a0827 service nova] Acquiring lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.neutron [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updating instance_info_cache with network_info: [{"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Releasing lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-184b9120-23ae-4c5d-8723-54258b97304e req-60ddee6f-3b0b-4d8b-8264-8fc2dd0a0827 service nova] Acquired lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-184b9120-23ae-4c5d-8723-54258b97304e req-60ddee6f-3b0b-4d8b-8264-8fc2dd0a0827 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Refreshing network info cache for port d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178282304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178282304',id=4,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkwVGCdlBlVcOiwisZJ2m7rAADqLOL+kywXDgvAwR2qTgTTFDHWjasH/U7eolNcNHdZLXQQor9tYHlFwFKvEPgekkTkSGi0+Q6MQwEnZ2+/phVBP+RILBn2kgk74jej4g==',key_name='tempest-keypair-1982021055',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df7d5f3696b24e6a8c96af89e7316ead',ramdisk_id='',reservation_id='r-3sr5sqxw',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-330612610',owner_user_name='tempest-TaggedAttachmentsTest-330612610-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e7e96b636034002b8994454bc89fdba',uuid=796d2c15-1728-4cd2-a325-e9385556050f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converting VIF {"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9b:5a,bridge_name='br-int',has_traffic_filtering=True,id=d1fd1d06-a240-4248-bcbd-4ece6691d8a0,network=Network(0770b32d-1b12-42fc-84a1-77339ca53fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1fd1d06-a2') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG os_vif [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9b:5a,bridge_name='br-int',has_traffic_filtering=True,id=d1fd1d06-a240-4248-bcbd-4ece6691d8a0,network=Network(0770b32d-1b12-42fc-84a1-77339ca53fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1fd1d06-a2') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1fd1d06-a2, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1fd1d06-a2, col_values=(('external_ids', {'iface-id': 'd1fd1d06-a240-4248-bcbd-4ece6691d8a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:9b:5a', 'vm-uuid': '796d2c15-1728-4cd2-a325-e9385556050f'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: INFO os_vif [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9b:5a,bridge_name='br-int',has_traffic_filtering=True,id=d1fd1d06-a240-4248-bcbd-4ece6691d8a0,network=Network(0770b32d-1b12-42fc-84a1-77339ca53fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1fd1d06-a2')
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178282304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178282304',id=4,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkwVGCdlBlVcOiwisZJ2m7rAADqLOL+kywXDgvAwR2qTgTTFDHWjasH/U7eolNcNHdZLXQQor9tYHlFwFKvEPgekkTkSGi0+Q6MQwEnZ2+/phVBP+RILBn2kgk74jej4g==',key_name='tempest-keypair-1982021055',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df7d5f3696b24e6a8c96af89e7316ead',ramdisk_id='',reservation_id='r-3sr5sqxw',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-330612610',owner_user_name='tempest-TaggedAttachmentsTest-330612610-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e7e96b636034002b8994454bc89fdba',uuid=796d2c15-1728-4cd2-a325-e9385556050f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converting VIF {"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9b:5a,bridge_name='br-int',has_traffic_filtering=True,id=d1fd1d06-a240-4248-bcbd-4ece6691d8a0,network=Network(0770b32d-1b12-42fc-84a1-77339ca53fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1fd1d06-a2') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] attach device xml: <interface type="ethernet">
Aug 17 21:17:27 user nova-compute[72818]:   <mac address="fa:16:3e:9e:9b:5a"/>
Aug 17 21:17:27 user nova-compute[72818]:   <model type="virtio"/>
Aug 17 21:17:27 user nova-compute[72818]:   <mtu size="1442"/>
Aug 17 21:17:27 user nova-compute[72818]:   <target dev="tapd1fd1d06-a2"/>
Aug 17 21:17:27 user nova-compute[72818]: </interface>
Aug 17 21:17:27 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBLqHMxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.434s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] <== connect_volume: return (2436ms) {'type': 'block', 'scsi_wwn': '23965336539623534', 'path': '/dev/sdg'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965336539623534', 'path': '/dev/sdg'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8c:3c,bridge_name='br-int',has_traffic_filtering=True,id=69dadb43-0aba-4637-a9ac-b7214b9f37b0,network=Network(3e829335-f525-476c-8a61-05620e158170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69dadb43-0a') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6e:e6,bridge_name='br-int',has_traffic_filtering=True,id=26243f2d-fe21-428b-b9bf-a1358aa60158,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26243f2d-fe') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=d7aef91f-c547-400d-abf5-6da4ab08a52f,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7aef91f-c5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:e8:12,bridge_name='br-int',has_traffic_filtering=True,id=bdd056c9-17af-4dfa-bf6b-a892b20bd869,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd056c9-17') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:12:24,bridge_name='br-int',has_traffic_filtering=True,id=b45072f7-8d1e-4d77-875e-92172d9ad7d7,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45072f7-8d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "address": "fa:16:3e:9b:c5:5d", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b783d7f-a2", "ovs_interfaceid": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "address": "fa:16:3e:9b:c5:5d", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b783d7f-a2", "ovs_interfaceid": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c5:5d,bridge_name='br-int',has_traffic_filtering=True,id=9b783d7f-a2aa-459d-9602-3d30eb4ac08c,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b783d7f-a2') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:36:75,bridge_name='br-int',has_traffic_filtering=True,id=7851b371-1f54-4adc-af39-dd6e60f98e9d,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7851b371-1f') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.objects.instance [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lazy-loading 'pci_devices' on Instance uuid 279a0c9c-91a3-4c5b-8918-b1a9278b59ac {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:17:27 user nova-compute[72818]:   <uuid>279a0c9c-91a3-4c5b-8918-b1a9278b59ac</uuid>
Aug 17 21:17:27 user nova-compute[72818]:   <name>instance-00000009</name>
Aug 17 21:17:27 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:17:27 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:17:27 user nova-compute[72818]:   <metadata>
Aug 17 21:17:27 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:17:27 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:17:27 user nova-compute[72818]:       <nova:name>tempest-device-tagging-server-934677209</nova:name>
Aug 17 21:17:27 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:17:21</nova:creationTime>
Aug 17 21:17:27 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:17:27 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:17:27 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:17:27 user nova-compute[72818]:       <nova:owner>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:user uuid="a52192f72fa646ec8422d0e623f9922d">tempest-TaggedBootDevicesTest_v242-1320279136-project-member</nova:user>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:project uuid="7c8397a213614aa8ae114a39b2669d35">tempest-TaggedBootDevicesTest_v242-1320279136</nova:project>
Aug 17 21:17:27 user nova-compute[72818]:       </nova:owner>
Aug 17 21:17:27 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:17:27 user nova-compute[72818]:       <nova:ports>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:port uuid="69dadb43-0aba-4637-a9ac-b7214b9f37b0">
Aug 17 21:17:27 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 21:17:27 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:port uuid="26243f2d-fe21-428b-b9bf-a1358aa60158">
Aug 17 21:17:27 user nova-compute[72818]:           <nova:ip type="fixed" address="10.1.1.144" ipVersion="4"/>
Aug 17 21:17:27 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:port uuid="d7aef91f-c547-400d-abf5-6da4ab08a52f">
Aug 17 21:17:27 user nova-compute[72818]:           <nova:ip type="fixed" address="10.1.1.251" ipVersion="4"/>
Aug 17 21:17:27 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:port uuid="bdd056c9-17af-4dfa-bf6b-a892b20bd869">
Aug 17 21:17:27 user nova-compute[72818]:           <nova:ip type="fixed" address="10.1.1.95" ipVersion="4"/>
Aug 17 21:17:27 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:port uuid="b45072f7-8d1e-4d77-875e-92172d9ad7d7">
Aug 17 21:17:27 user nova-compute[72818]:           <nova:ip type="fixed" address="10.1.1.187" ipVersion="4"/>
Aug 17 21:17:27 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:port uuid="9b783d7f-a2aa-459d-9602-3d30eb4ac08c">
Aug 17 21:17:27 user nova-compute[72818]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 21:17:27 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:27 user nova-compute[72818]:         <nova:port uuid="7851b371-1f54-4adc-af39-dd6e60f98e9d">
Aug 17 21:17:27 user nova-compute[72818]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 21:17:27 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:27 user nova-compute[72818]:       </nova:ports>
Aug 17 21:17:27 user nova-compute[72818]:     </nova:instance>
Aug 17 21:17:27 user nova-compute[72818]:   </metadata>
Aug 17 21:17:27 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:17:27 user nova-compute[72818]:     <system>
Aug 17 21:17:27 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:17:27 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:17:27 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:17:27 user nova-compute[72818]:       <entry name="serial">279a0c9c-91a3-4c5b-8918-b1a9278b59ac</entry>
Aug 17 21:17:27 user nova-compute[72818]:       <entry name="uuid">279a0c9c-91a3-4c5b-8918-b1a9278b59ac</entry>
Aug 17 21:17:27 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:17:27 user nova-compute[72818]:     </system>
Aug 17 21:17:27 user nova-compute[72818]:   </sysinfo>
Aug 17 21:17:27 user nova-compute[72818]:   <os>
Aug 17 21:17:27 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:17:27 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:17:27 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:17:27 user nova-compute[72818]:   </os>
Aug 17 21:17:27 user nova-compute[72818]:   <features>
Aug 17 21:17:27 user nova-compute[72818]:     <acpi/>
Aug 17 21:17:27 user nova-compute[72818]:     <apic/>
Aug 17 21:17:27 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:17:27 user nova-compute[72818]:   </features>
Aug 17 21:17:27 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:17:27 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:17:27 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:17:27 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:17:27 user nova-compute[72818]:   </clock>
Aug 17 21:17:27 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:17:27 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:17:27 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:17:27 user nova-compute[72818]:   </cpu>
Aug 17 21:17:27 user nova-compute[72818]:   <devices>
Aug 17 21:17:27 user nova-compute[72818]:     <disk type="file" device="cdrom">
Aug 17 21:17:27 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 21:17:27 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/279a0c9c-91a3-4c5b-8918-b1a9278b59ac/disk.config"/>
Aug 17 21:17:27 user nova-compute[72818]:       <target dev="hda" bus="ide"/>
Aug 17 21:17:27 user nova-compute[72818]:     </disk>
Aug 17 21:17:27 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:17:27 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:27 user nova-compute[72818]:       <source dev="/dev/sdd"/>
Aug 17 21:17:27 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:17:27 user nova-compute[72818]:       <serial>be2f0d88-dc09-4a49-8c8c-bde11b1a157a</serial>
Aug 17 21:17:27 user nova-compute[72818]:     </disk>
Aug 17 21:17:27 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:17:27 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:27 user nova-compute[72818]:       <source dev="/dev/sdf"/>
Aug 17 21:17:27 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:17:27 user nova-compute[72818]:       <serial>ba0c56f6-aaef-4f42-8704-f37701694b3b</serial>
Aug 17 21:17:27 user nova-compute[72818]:     </disk>
Aug 17 21:17:27 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:17:27 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:27 user nova-compute[72818]:       <source dev="/dev/sdg"/>
Aug 17 21:17:27 user nova-compute[72818]:       <target dev="vdc" bus="virtio"/>
Aug 17 21:17:27 user nova-compute[72818]:       <serial>5515ad1e-fe92-498d-95f4-3f7bf824d51a</serial>
Aug 17 21:17:27 user nova-compute[72818]:     </disk>
Aug 17 21:17:27 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:27 user nova-compute[72818]:       <mac address="fa:16:3e:4c:8c:3c"/>
Aug 17 21:17:27 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:27 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:27 user nova-compute[72818]:       <target dev="tap69dadb43-0a"/>
Aug 17 21:17:27 user nova-compute[72818]:     </interface>
Aug 17 21:17:27 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:27 user nova-compute[72818]:       <mac address="fa:16:3e:d2:6e:e6"/>
Aug 17 21:17:27 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:27 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:27 user nova-compute[72818]:       <target dev="tap26243f2d-fe"/>
Aug 17 21:17:27 user nova-compute[72818]:     </interface>
Aug 17 21:17:27 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:27 user nova-compute[72818]:       <mac address="fa:16:3e:cd:91:ee"/>
Aug 17 21:17:27 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:27 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:27 user nova-compute[72818]:       <target dev="tapd7aef91f-c5"/>
Aug 17 21:17:27 user nova-compute[72818]:     </interface>
Aug 17 21:17:27 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:27 user nova-compute[72818]:       <mac address="fa:16:3e:13:e8:12"/>
Aug 17 21:17:27 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:27 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:27 user nova-compute[72818]:       <target dev="tapbdd056c9-17"/>
Aug 17 21:17:27 user nova-compute[72818]:     </interface>
Aug 17 21:17:27 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:27 user nova-compute[72818]:       <mac address="fa:16:3e:5a:12:24"/>
Aug 17 21:17:27 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:27 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:27 user nova-compute[72818]:       <target dev="tapb45072f7-8d"/>
Aug 17 21:17:27 user nova-compute[72818]:     </interface>
Aug 17 21:17:27 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:27 user nova-compute[72818]:       <mac address="fa:16:3e:9b:c5:5d"/>
Aug 17 21:17:27 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:27 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:27 user nova-compute[72818]:       <target dev="tap9b783d7f-a2"/>
Aug 17 21:17:27 user nova-compute[72818]:     </interface>
Aug 17 21:17:27 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:27 user nova-compute[72818]:       <mac address="fa:16:3e:22:36:75"/>
Aug 17 21:17:27 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:27 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:27 user nova-compute[72818]:       <target dev="tap7851b371-1f"/>
Aug 17 21:17:27 user nova-compute[72818]:     </interface>
Aug 17 21:17:27 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:17:27 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/279a0c9c-91a3-4c5b-8918-b1a9278b59ac/console.log" append="off"/>
Aug 17 21:17:27 user nova-compute[72818]:     </serial>
Aug 17 21:17:27 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:17:27 user nova-compute[72818]:     <video>
Aug 17 21:17:27 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:27 user nova-compute[72818]:     </video>
Aug 17 21:17:27 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:17:27 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:17:27 user nova-compute[72818]:     </rng>
Aug 17 21:17:27 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:17:27 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:17:27 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:17:27 user nova-compute[72818]:     </memballoon>
Aug 17 21:17:27 user nova-compute[72818]:   </devices>
Aug 17 21:17:27 user nova-compute[72818]: </domain>
Aug 17 21:17:27 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8c:3c,bridge_name='br-int',has_traffic_filtering=True,id=69dadb43-0aba-4637-a9ac-b7214b9f37b0,network=Network(3e829335-f525-476c-8a61-05620e158170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69dadb43-0a') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8c:3c,bridge_name='br-int',has_traffic_filtering=True,id=69dadb43-0aba-4637-a9ac-b7214b9f37b0,network=Network(3e829335-f525-476c-8a61-05620e158170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69dadb43-0a') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] No BDM found with device name hda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] No VIF found with MAC fa:16:3e:1c:94:f9, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69dadb43-0a, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69dadb43-0a, col_values=(('external_ids', {'iface-id': '69dadb43-0aba-4637-a9ac-b7214b9f37b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:8c:3c', 'vm-uuid': '279a0c9c-91a3-4c5b-8918-b1a9278b59ac'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: INFO os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8c:3c,bridge_name='br-int',has_traffic_filtering=True,id=69dadb43-0aba-4637-a9ac-b7214b9f37b0,network=Network(3e829335-f525-476c-8a61-05620e158170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69dadb43-0a')
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6e:e6,bridge_name='br-int',has_traffic_filtering=True,id=26243f2d-fe21-428b-b9bf-a1358aa60158,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26243f2d-fe') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6e:e6,bridge_name='br-int',has_traffic_filtering=True,id=26243f2d-fe21-428b-b9bf-a1358aa60158,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26243f2d-fe') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:17:27 user nova-compute[72818]:   <nova:package version="0.0.0"/>
Aug 17 21:17:27 user nova-compute[72818]:   <nova:name>tempest-device-tagging-server-178282304</nova:name>
Aug 17 21:17:27 user nova-compute[72818]:   <nova:creationTime>2023-08-17 21:17:27</nova:creationTime>
Aug 17 21:17:27 user nova-compute[72818]:   <nova:flavor name="m1.tiny">
Aug 17 21:17:27 user nova-compute[72818]:     <nova:memory>512</nova:memory>
Aug 17 21:17:27 user nova-compute[72818]:     <nova:disk>1</nova:disk>
Aug 17 21:17:27 user nova-compute[72818]:     <nova:swap>0</nova:swap>
Aug 17 21:17:27 user nova-compute[72818]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:17:27 user nova-compute[72818]:     <nova:vcpus>1</nova:vcpus>
Aug 17 21:17:27 user nova-compute[72818]:   </nova:flavor>
Aug 17 21:17:27 user nova-compute[72818]:   <nova:owner>
Aug 17 21:17:27 user nova-compute[72818]:     <nova:user uuid="0e7e96b636034002b8994454bc89fdba">tempest-TaggedAttachmentsTest-330612610-project-member</nova:user>
Aug 17 21:17:27 user nova-compute[72818]:     <nova:project uuid="df7d5f3696b24e6a8c96af89e7316ead">tempest-TaggedAttachmentsTest-330612610</nova:project>
Aug 17 21:17:27 user nova-compute[72818]:   </nova:owner>
Aug 17 21:17:27 user nova-compute[72818]:   <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:17:27 user nova-compute[72818]:   <nova:ports>
Aug 17 21:17:27 user nova-compute[72818]:     <nova:port uuid="5e1c71f4-af86-4f7a-8dcf-0210699e469b">
Aug 17 21:17:27 user nova-compute[72818]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 21:17:27 user nova-compute[72818]:     </nova:port>
Aug 17 21:17:27 user nova-compute[72818]:     <nova:port uuid="d1fd1d06-a240-4248-bcbd-4ece6691d8a0">
Aug 17 21:17:27 user nova-compute[72818]:       <nova:ip type="fixed" address="10.10.10.137" ipVersion="4"/>
Aug 17 21:17:27 user nova-compute[72818]:     </nova:port>
Aug 17 21:17:27 user nova-compute[72818]:   </nova:ports>
Aug 17 21:17:27 user nova-compute[72818]: </nova:instance>
Aug 17 21:17:27 user nova-compute[72818]:  {{(pid=72818) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26243f2d-fe, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26243f2d-fe, col_values=(('external_ids', {'iface-id': '26243f2d-fe21-428b-b9bf-a1358aa60158', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:6e:e6', 'vm-uuid': '279a0c9c-91a3-4c5b-8918-b1a9278b59ac'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: INFO os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6e:e6,bridge_name='br-int',has_traffic_filtering=True,id=26243f2d-fe21-428b-b9bf-a1358aa60158,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26243f2d-fe')
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=d7aef91f-c547-400d-abf5-6da4ab08a52f,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7aef91f-c5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=d7aef91f-c547-400d-abf5-6da4ab08a52f,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7aef91f-c5') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a327ee97-b471-4ec4-b5d2-bc0606e991c6 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "interface-796d2c15-1728-4cd2-a325-e9385556050f-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 6.319s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7aef91f-c5, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7aef91f-c5, col_values=(('external_ids', {'iface-id': 'd7aef91f-c547-400d-abf5-6da4ab08a52f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:91:ee', 'vm-uuid': '279a0c9c-91a3-4c5b-8918-b1a9278b59ac'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: INFO os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=d7aef91f-c547-400d-abf5-6da4ab08a52f,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7aef91f-c5')
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:e8:12,bridge_name='br-int',has_traffic_filtering=True,id=bdd056c9-17af-4dfa-bf6b-a892b20bd869,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd056c9-17') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:e8:12,bridge_name='br-int',has_traffic_filtering=True,id=bdd056c9-17af-4dfa-bf6b-a892b20bd869,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd056c9-17') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdd056c9-17, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbdd056c9-17, col_values=(('external_ids', {'iface-id': 'bdd056c9-17af-4dfa-bf6b-a892b20bd869', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:e8:12', 'vm-uuid': '279a0c9c-91a3-4c5b-8918-b1a9278b59ac'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: INFO os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:e8:12,bridge_name='br-int',has_traffic_filtering=True,id=bdd056c9-17af-4dfa-bf6b-a892b20bd869,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd056c9-17')
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:12:24,bridge_name='br-int',has_traffic_filtering=True,id=b45072f7-8d1e-4d77-875e-92172d9ad7d7,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45072f7-8d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:12:24,bridge_name='br-int',has_traffic_filtering=True,id=b45072f7-8d1e-4d77-875e-92172d9ad7d7,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45072f7-8d') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb45072f7-8d, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb45072f7-8d, col_values=(('external_ids', {'iface-id': 'b45072f7-8d1e-4d77-875e-92172d9ad7d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:12:24', 'vm-uuid': '279a0c9c-91a3-4c5b-8918-b1a9278b59ac'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG nova.network.neutron [req-184b9120-23ae-4c5d-8723-54258b97304e req-60ddee6f-3b0b-4d8b-8264-8fc2dd0a0827 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updated VIF entry in instance network info cache for port d1fd1d06-a240-4248-bcbd-4ece6691d8a0. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG nova.network.neutron [req-184b9120-23ae-4c5d-8723-54258b97304e req-60ddee6f-3b0b-4d8b-8264-8fc2dd0a0827 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updating instance_info_cache with network_info: [{"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:28 user nova-compute[72818]: INFO os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:12:24,bridge_name='br-int',has_traffic_filtering=True,id=b45072f7-8d1e-4d77-875e-92172d9ad7d7,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45072f7-8d')
Aug 17 21:17:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "address": "fa:16:3e:9b:c5:5d", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b783d7f-a2", "ovs_interfaceid": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "address": "fa:16:3e:9b:c5:5d", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b783d7f-a2", "ovs_interfaceid": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c5:5d,bridge_name='br-int',has_traffic_filtering=True,id=9b783d7f-a2aa-459d-9602-3d30eb4ac08c,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b783d7f-a2') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c5:5d,bridge_name='br-int',has_traffic_filtering=True,id=9b783d7f-a2aa-459d-9602-3d30eb4ac08c,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b783d7f-a2') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b783d7f-a2, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b783d7f-a2, col_values=(('external_ids', {'iface-id': '9b783d7f-a2aa-459d-9602-3d30eb4ac08c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:c5:5d', 'vm-uuid': '279a0c9c-91a3-4c5b-8918-b1a9278b59ac'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-184b9120-23ae-4c5d-8723-54258b97304e req-60ddee6f-3b0b-4d8b-8264-8fc2dd0a0827 service nova] Releasing lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:28 user nova-compute[72818]: INFO os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c5:5d,bridge_name='br-int',has_traffic_filtering=True,id=9b783d7f-a2aa-459d-9602-3d30eb4ac08c,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b783d7f-a2')
Aug 17 21:17:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:36:75,bridge_name='br-int',has_traffic_filtering=True,id=7851b371-1f54-4adc-af39-dd6e60f98e9d,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7851b371-1f') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:36:75,bridge_name='br-int',has_traffic_filtering=True,id=7851b371-1f54-4adc-af39-dd6e60f98e9d,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7851b371-1f') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7851b371-1f, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7851b371-1f, col_values=(('external_ids', {'iface-id': '7851b371-1f54-4adc-af39-dd6e60f98e9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:36:75', 'vm-uuid': '279a0c9c-91a3-4c5b-8918-b1a9278b59ac'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:28 user nova-compute[72818]: INFO os_vif [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:36:75,bridge_name='br-int',has_traffic_filtering=True,id=7851b371-1f54-4adc-af39-dd6e60f98e9d,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7851b371-1f')
Aug 17 21:17:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] No BDM found with device name hda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] No VIF found with MAC fa:16:3e:4c:8c:3c, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] No VIF found with MAC fa:16:3e:5a:12:24, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Using config drive
Aug 17 21:17:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Creating config drive at /opt/stack/data/nova/instances/279a0c9c-91a3-4c5b-8918-b1a9278b59ac/disk.config
Aug 17 21:17:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/279a0c9c-91a3-4c5b-8918-b1a9278b59ac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4z07apsn {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/279a0c9c-91a3-4c5b-8918-b1a9278b59ac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4z07apsn" returned: 0 in 0.065s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-b1aa6f6e-de92-4c89-ab84-67212041ece8 req-1458ef82-1963-4dac-87c7-305a2cff9a97 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b1aa6f6e-de92-4c89-ab84-67212041ece8 req-1458ef82-1963-4dac-87c7-305a2cff9a97 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b1aa6f6e-de92-4c89-ab84-67212041ece8 req-1458ef82-1963-4dac-87c7-305a2cff9a97 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b1aa6f6e-de92-4c89-ab84-67212041ece8 req-1458ef82-1963-4dac-87c7-305a2cff9a97 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-b1aa6f6e-de92-4c89-ab84-67212041ece8 req-1458ef82-1963-4dac-87c7-305a2cff9a97 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:30 user nova-compute[72818]: WARNING nova.compute.manager [req-b1aa6f6e-de92-4c89-ab84-67212041ece8 req-1458ef82-1963-4dac-87c7-305a2cff9a97 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-69dadb43-0aba-4637-a9ac-b7214b9f37b0 for instance with vm_state building and task_state spawning.
Aug 17 21:17:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-92fcfa26-cf8d-4fee-82b4-2937ea1ff635 req-5434237e-4c07-4928-9860-078d9c2c4bfc service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-vif-plugged-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-92fcfa26-cf8d-4fee-82b4-2937ea1ff635 req-5434237e-4c07-4928-9860-078d9c2c4bfc service nova] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-92fcfa26-cf8d-4fee-82b4-2937ea1ff635 req-5434237e-4c07-4928-9860-078d9c2c4bfc service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-92fcfa26-cf8d-4fee-82b4-2937ea1ff635 req-5434237e-4c07-4928-9860-078d9c2c4bfc service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-92fcfa26-cf8d-4fee-82b4-2937ea1ff635 req-5434237e-4c07-4928-9860-078d9c2c4bfc service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] No waiting events found dispatching network-vif-plugged-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:31 user nova-compute[72818]: WARNING nova.compute.manager [req-92fcfa26-cf8d-4fee-82b4-2937ea1ff635 req-5434237e-4c07-4928-9860-078d9c2c4bfc service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received unexpected event network-vif-plugged-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 for instance with vm_state active and task_state None.
Aug 17 21:17:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-8442ea9f-7ed9-458f-8384-97d1e415855d req-e64e354a-cc09-420e-a425-d19bdd396f98 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8442ea9f-7ed9-458f-8384-97d1e415855d req-e64e354a-cc09-420e-a425-d19bdd396f98 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8442ea9f-7ed9-458f-8384-97d1e415855d req-e64e354a-cc09-420e-a425-d19bdd396f98 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8442ea9f-7ed9-458f-8384-97d1e415855d req-e64e354a-cc09-420e-a425-d19bdd396f98 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-8442ea9f-7ed9-458f-8384-97d1e415855d req-e64e354a-cc09-420e-a425-d19bdd396f98 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:31 user nova-compute[72818]: WARNING nova.compute.manager [req-8442ea9f-7ed9-458f-8384-97d1e415855d req-e64e354a-cc09-420e-a425-d19bdd396f98 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-bdd056c9-17af-4dfa-bf6b-a892b20bd869 for instance with vm_state building and task_state spawning.
Aug 17 21:17:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:32 user nova-compute[72818]: WARNING nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-69dadb43-0aba-4637-a9ac-b7214b9f37b0 for instance with vm_state building and task_state spawning.
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-26243f2d-fe21-428b-b9bf-a1358aa60158 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-26243f2d-fe21-428b-b9bf-a1358aa60158 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:32 user nova-compute[72818]: WARNING nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-26243f2d-fe21-428b-b9bf-a1358aa60158 for instance with vm_state building and task_state spawning.
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-26243f2d-fe21-428b-b9bf-a1358aa60158 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-26243f2d-fe21-428b-b9bf-a1358aa60158 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:32 user nova-compute[72818]: WARNING nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-26243f2d-fe21-428b-b9bf-a1358aa60158 for instance with vm_state building and task_state spawning.
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-d7aef91f-c547-400d-abf5-6da4ab08a52f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-d7aef91f-c547-400d-abf5-6da4ab08a52f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:32 user nova-compute[72818]: WARNING nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-d7aef91f-c547-400d-abf5-6da4ab08a52f for instance with vm_state building and task_state spawning.
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-d7aef91f-c547-400d-abf5-6da4ab08a52f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-d7aef91f-c547-400d-abf5-6da4ab08a52f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:32 user nova-compute[72818]: WARNING nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-d7aef91f-c547-400d-abf5-6da4ab08a52f for instance with vm_state building and task_state spawning.
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:32 user nova-compute[72818]: WARNING nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-b45072f7-8d1e-4d77-875e-92172d9ad7d7 for instance with vm_state building and task_state spawning.
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:32 user nova-compute[72818]: WARNING nova.compute.manager [req-4f76c7a5-3d62-402e-91a1-39db7cc7821e req-67bb1d05-098e-4e34-a035-0499da78bac7 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-b45072f7-8d1e-4d77-875e-92172d9ad7d7 for instance with vm_state building and task_state spawning.
Aug 17 21:17:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-vif-plugged-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] No waiting events found dispatching network-vif-plugged-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:33 user nova-compute[72818]: WARNING nova.compute.manager [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received unexpected event network-vif-plugged-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 for instance with vm_state active and task_state None.
Aug 17 21:17:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:33 user nova-compute[72818]: WARNING nova.compute.manager [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-9b783d7f-a2aa-459d-9602-3d30eb4ac08c for instance with vm_state building and task_state spawning.
Aug 17 21:17:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:33 user nova-compute[72818]: WARNING nova.compute.manager [req-3f627685-4948-49bd-9534-49bcd6101906 req-731df987-52f9-4d33-8a8f-e6de6b9ec54f service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-9b783d7f-a2aa-459d-9602-3d30eb4ac08c for instance with vm_state building and task_state spawning.
Aug 17 21:17:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-859f5a3b-a5e7-4c4c-b3de-5762ab08d8de req-12a3ef82-b3af-4533-b696-fddcd642c5fa service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-859f5a3b-a5e7-4c4c-b3de-5762ab08d8de req-12a3ef82-b3af-4533-b696-fddcd642c5fa service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-859f5a3b-a5e7-4c4c-b3de-5762ab08d8de req-12a3ef82-b3af-4533-b696-fddcd642c5fa service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-859f5a3b-a5e7-4c4c-b3de-5762ab08d8de req-12a3ef82-b3af-4533-b696-fddcd642c5fa service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-859f5a3b-a5e7-4c4c-b3de-5762ab08d8de req-12a3ef82-b3af-4533-b696-fddcd642c5fa service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:33 user nova-compute[72818]: WARNING nova.compute.manager [req-859f5a3b-a5e7-4c4c-b3de-5762ab08d8de req-12a3ef82-b3af-4533-b696-fddcd642c5fa service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-bdd056c9-17af-4dfa-bf6b-a892b20bd869 for instance with vm_state building and task_state spawning.
Aug 17 21:17:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307054.548179, 279a0c9c-91a3-4c5b-8918-b1a9278b59ac => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:17:34 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] VM Resumed (Lifecycle Event)
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:17:34 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Instance spawned successfully.
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:17:34 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307054.5502188, 279a0c9c-91a3-4c5b-8918-b1a9278b59ac => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:17:34 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] VM Started (Lifecycle Event)
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-142e6c06-5390-430d-8665-2ed9710b6e8a req-ed093d7a-861d-4103-9e4c-eddc8f9d22a1 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-142e6c06-5390-430d-8665-2ed9710b6e8a req-ed093d7a-861d-4103-9e4c-eddc8f9d22a1 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-142e6c06-5390-430d-8665-2ed9710b6e8a req-ed093d7a-861d-4103-9e4c-eddc8f9d22a1 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-142e6c06-5390-430d-8665-2ed9710b6e8a req-ed093d7a-861d-4103-9e4c-eddc8f9d22a1 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-142e6c06-5390-430d-8665-2ed9710b6e8a req-ed093d7a-861d-4103-9e4c-eddc8f9d22a1 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:34 user nova-compute[72818]: WARNING nova.compute.manager [req-142e6c06-5390-430d-8665-2ed9710b6e8a req-ed093d7a-861d-4103-9e4c-eddc8f9d22a1 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-7851b371-1f54-4adc-af39-dd6e60f98e9d for instance with vm_state building and task_state spawning.
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-142e6c06-5390-430d-8665-2ed9710b6e8a req-ed093d7a-861d-4103-9e4c-eddc8f9d22a1 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-142e6c06-5390-430d-8665-2ed9710b6e8a req-ed093d7a-861d-4103-9e4c-eddc8f9d22a1 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-142e6c06-5390-430d-8665-2ed9710b6e8a req-ed093d7a-861d-4103-9e4c-eddc8f9d22a1 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-142e6c06-5390-430d-8665-2ed9710b6e8a req-ed093d7a-861d-4103-9e4c-eddc8f9d22a1 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-142e6c06-5390-430d-8665-2ed9710b6e8a req-ed093d7a-861d-4103-9e4c-eddc8f9d22a1 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:34 user nova-compute[72818]: WARNING nova.compute.manager [req-142e6c06-5390-430d-8665-2ed9710b6e8a req-ed093d7a-861d-4103-9e4c-eddc8f9d22a1 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-7851b371-1f54-4adc-af39-dd6e60f98e9d for instance with vm_state building and task_state spawning.
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:17:34 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:17:34 user nova-compute[72818]: INFO nova.compute.manager [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Took 12.99 seconds to spawn the instance on the hypervisor.
Aug 17 21:17:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:17:34 user nova-compute[72818]: INFO nova.compute.manager [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Took 66.78 seconds to build instance.
Aug 17 21:17:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e1b20ebb-31fa-46d6-ad4f-06aa6fed5c0d tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 66.889s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujNofVtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:38 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:38 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:38 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1ef4d3-4830-4b3c-ab80-01f089a676df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:17:38 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[289899a6-2cde-4f31-b5ef-cd9064297c52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659] added
Aug 17 21:17:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b653bf4-627b-4df3-9255-4073e79fad9b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c4afe0-ab51-471a-bdb5-f4cd5f0058fe]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujNofVtb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujNofVtb" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9e18f8-dd99-4915-87aa-5c767612d45b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ujNofVtb'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1c253f-22af-4341-a4a1-cf3bbf1f79a1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5b695c-8a26-44eb-a757-b13a30e9ce15]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cb50ce-5ec6-4a4c-9168-b864f3064a34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659, portal: 172.16.0.220,3260]
Aug 17 21:17:38 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659, portal: 172.16.0.220,3260] successful.
Aug 17 21:17:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[722c5295-3267-4e6b-9257-c1f30d1a7c59]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305926b-20bb-452b-99d2-846f383f798d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)
Aug 17 21:17:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:38 user nova-compute[72818]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)
Aug 17 21:17:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "796d2c15-1728-4cd2-a325-e9385556050f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG nova.objects.instance [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lazy-loading 'flavor' on Instance uuid 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e69be76-b3cd-4c55-a567-ce23574850d7]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujNofVtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:17:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "796d2c15-1728-4cd2-a325-e9385556050f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:39 user nova-compute[72818]: DEBUG nova.objects.instance [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lazy-loading 'flavor' on Instance uuid e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "796d2c15-1728-4cd2-a325-e9385556050f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:39 user nova-compute[72818]: INFO nova.compute.manager [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Attaching volume d829af72-a52e-46bb-bc5b-035eefcb738f to /dev/vdb
Aug 17 21:17:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:39 user nova-compute[72818]: INFO nova.compute.manager [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Attaching volume 1844d539-e63c-4895-8b38-86ba8d7fbddb to /dev/sdc
Aug 17 21:17:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26334643666636530', 'path': '/dev/sdh'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334643666636530', 'path': '/dev/sdh'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:17:39 user nova-compute[72818]: DEBUG nova.objects.instance [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lazy-loading 'flavor' on Instance uuid b93c6b2f-59ee-4e7f-9805-97ef627eccdb {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:17:39 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:39 user nova-compute[72818]:   <source dev="/dev/sdh"/>
Aug 17 21:17:39 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:17:39 user nova-compute[72818]:   <serial>68084487-5b53-4ac7-b805-96652c359659</serial>
Aug 17 21:17:39 user nova-compute[72818]: </disk>
Aug 17 21:17:39 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EoNGhWKB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:40 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:40 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:40 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[106c193b-cd83-4297-beb0-6edc2829b3f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:17:40 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.utils [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7052aff8-862d-4cfa-b942-f61cd588266f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744] added
Aug 17 21:17:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1bfe94-8d68-437a-bc85-7d81b631bd9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f13395-388c-43b5-8bed-c713ad83a890]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65fea5c-9273-459e-95af-6d4a44475e6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f63afa-f1d3-49ec-b9a1-a79b230c5fac]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EoNGhWKB {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[26051c55-ab72-4a0a-8dad-17b71a1f8a9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d0981d-2682-4a49-8108-9c1237122531]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.utils [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EoNGhWKB" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[505f2bb9-e66c-4ca6-8fb0-ee35a8dee5df]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EoNGhWKB'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca50b08-82ce-461f-81de-578c29cc60fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d941fbb-abce-449f-ac1f-b565d95271ee]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:40 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[136b773f-1364-4328-a7c9-232cccd6f898]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.utils [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updating existing volume attachment record: fee7c06e-aadd-446f-812c-8d2f9aae2731 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4501f6d5-9845-461e-a09a-730b6beb3d58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0120856d-8d9f-4161-b01e-91f573290344]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eab8ba8-bde4-4398-86ad-68000a5a9879]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7eac95-43f5-4062-ac2c-6518ec219f17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:40 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[391e823e-4390-46b1-96a3-44455daac0bd]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.utils [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Updating existing volume attachment record: b33680bf-ca2f-4962-ba90-f5e6b614b32e {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --login" returned: 0 in 0.117s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aed36e-f4ab-400a-bb73-c7a94da01348]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744, portal: 172.16.0.220,3260]
Aug 17 21:17:40 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744, portal: 172.16.0.220,3260] successful.
Aug 17 21:17:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[884d87ba-ac65-49a5-bc61-8a5c4784bbfa]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] No VIF found with MAC fa:16:3e:69:af:13, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f18fecf-e5f0-45d5-ad92-2e303a53734b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:40 user nova-compute[72818]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)
Aug 17 21:17:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abf8996-cc0b-439b-bfe5-f708a370cc8f]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:40 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:17:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:41 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:17:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EoNGhWKB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:17:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] <== connect_volume: return (1487ms) {'type': 'block', 'scsi_wwn': '26636363231656662', 'path': '/dev/sdi'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636363231656662', 'path': '/dev/sdi'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:17:41 user nova-compute[72818]: DEBUG nova.objects.instance [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lazy-loading 'flavor' on Instance uuid 01fcc357-dc4c-4215-b3a5-b9cea51ed532 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:17:41 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:41 user nova-compute[72818]:   <source dev="/dev/sdi"/>
Aug 17 21:17:41 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:17:41 user nova-compute[72818]:   <serial>24964e89-33fc-4294-8db4-9db93143d744</serial>
Aug 17 21:17:41 user nova-compute[72818]: </disk>
Aug 17 21:17:41 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:17:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] No VIF found with MAC fa:16:3e:46:ab:48, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:45 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:17:45 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:17:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:17:46 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:17:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-b93c6b2f-59ee-4e7f-9805-97ef627eccdb" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-b93c6b2f-59ee-4e7f-9805-97ef627eccdb" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:46 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:17:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:17:47 user nova-compute[72818]: INFO nova.compute.claims [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Claim successful on node user
Aug 17 21:17:47 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Updating instance_info_cache with network_info: [{"id": "e94f410f-1593-4c05-ae40-a8c34f12c210", "address": "fa:16:3e:69:af:13", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94f410f-15", "ovs_interfaceid": "e94f410f-1593-4c05-ae40-a8c34f12c210", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-b93c6b2f-59ee-4e7f-9805-97ef627eccdb" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:17:47 user nova-compute[72818]: DEBUG nova.network.neutron [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:17:47 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:17:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:17:47 user nova-compute[72818]: INFO nova.virt.block_device [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Booting with blank volume at /dev/vda
Aug 17 21:17:47 user nova-compute[72818]: DEBUG nova.policy [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6cd1f219a2634975bb1362620392dc1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0b81a8a39436a9ec6e1646090f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG nova.network.neutron [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Successfully created port: 67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYqcWyEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:48 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:48 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:48 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[70085829-16c3-4512-a478-fb76e3638a23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:17:48 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9cd7f4-daf8-47c4-9bc9-363242bfb17e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd] added
Aug 17 21:17:48 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b52437-03c2-4592-aa4d-9886843241e6]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fe97dc-9d9e-405b-aa35-d07e4225d854]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CYqcWyEZ {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CYqcWyEZ" returned: 0 in 0.045s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5abf71-7bd9-45e3-afed-bdc803bc0f47]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CYqcWyEZ'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bb7ac4-17ce-44f3-acd2-df2474af3d87]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-76a63dcb-4bfd-4ac5-9994-a63f1903d26b tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.158s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[869716a1-5d5f-4856-be6e-894573fe602c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[36759935-d4cb-40fa-b34d-88ba4b555311]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd, portal: 172.16.0.220,3260]
Aug 17 21:17:48 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd, portal: 172.16.0.220,3260] successful.
Aug 17 21:17:48 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[879269f5-1a09-4642-a90f-2f11a2e107e4]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf2f3cb-1914-4e0b-a89d-be17814335d7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:48 user nova-compute[72818]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)
Aug 17 21:17:48 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[67785afd-f136-40d6-9a49-fe833975819a]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:48 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e56c6771-4c14-4b54-a4c9-b997ed9846e9 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.218s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG nova.network.neutron [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Successfully updated port: 67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquired lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG nova.network.neutron [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG nova.compute.manager [req-f5fb1f3a-db9b-4152-a4cc-c12d5e642497 req-8f5b42a0-55bd-437b-bb31-f06ffb9ac62b service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-changed-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG nova.compute.manager [req-f5fb1f3a-db9b-4152-a4cc-c12d5e642497 req-8f5b42a0-55bd-437b-bb31-f06ffb9ac62b service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Refreshing instance network info cache due to event network-changed-67586c8a-e841-4778-891e-27307f1dbe67. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f5fb1f3a-db9b-4152-a4cc-c12d5e642497 req-8f5b42a0-55bd-437b-bb31-f06ffb9ac62b service nova] Acquiring lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG nova.network.neutron [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG nova.network.neutron [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Updating instance_info_cache with network_info: [{"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Releasing lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG nova.compute.manager [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Instance network_info: |[{"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f5fb1f3a-db9b-4152-a4cc-c12d5e642497 req-8f5b42a0-55bd-437b-bb31-f06ffb9ac62b service nova] Acquired lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG nova.network.neutron [req-f5fb1f3a-db9b-4152-a4cc-c12d5e642497 req-8f5b42a0-55bd-437b-bb31-f06ffb9ac62b service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Refreshing network info cache for port 67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYqcWyEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '26132396233396466', 'path': '/dev/sdj'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132396233396466', 'path': '/dev/sdj'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:17:49 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lazy-loading 'flavor' on Instance uuid 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] attach device xml: <disk type="block" device="disk">
Aug 17 21:17:50 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:50 user nova-compute[72818]:   <source dev="/dev/sdj"/>
Aug 17 21:17:50 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:17:50 user nova-compute[72818]:   <serial>b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd</serial>
Aug 17 21:17:50 user nova-compute[72818]: </disk>
Aug 17 21:17:50 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG nova.network.neutron [req-f5fb1f3a-db9b-4152-a4cc-c12d5e642497 req-8f5b42a0-55bd-437b-bb31-f06ffb9ac62b service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Updated VIF entry in instance network info cache for port 67586c8a-e841-4778-891e-27307f1dbe67. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG nova.network.neutron [req-f5fb1f3a-db9b-4152-a4cc-c12d5e642497 req-8f5b42a0-55bd-437b-bb31-f06ffb9ac62b service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Updating instance_info_cache with network_info: [{"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f5fb1f3a-db9b-4152-a4cc-c12d5e642497 req-8f5b42a0-55bd-437b-bb31-f06ffb9ac62b service nova] Releasing lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] No VIF found with MAC fa:16:3e:fa:ed:ba, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:50 user nova-compute[72818]: INFO nova.compute.manager [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Detaching volume 68084487-5b53-4ac7-b805-96652c359659
Aug 17 21:17:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b44ad6-dd1d-4d9e-96c7-a0f8d8ac0a3a tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.871s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:50 user nova-compute[72818]: INFO nova.virt.block_device [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Attempting to driver detach volume 68084487-5b53-4ac7-b805-96652c359659 from mountpoint /dev/vdb
Aug 17 21:17:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Attempting to detach device vdb from instance b93c6b2f-59ee-4e7f-9805-97ef627eccdb from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:17:50 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:50 user nova-compute[72818]:   <source dev="/dev/sdh"/>
Aug 17 21:17:50 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:17:50 user nova-compute[72818]:   <serial>68084487-5b53-4ac7-b805-96652c359659</serial>
Aug 17 21:17:50 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:17:50 user nova-compute[72818]: </disk>
Aug 17 21:17:50 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:17:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Successfully detached device vdb from instance b93c6b2f-59ee-4e7f-9805-97ef627eccdb from the persistent domain config.
Aug 17 21:17:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b93c6b2f-59ee-4e7f-9805-97ef627eccdb from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:17:50 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:50 user nova-compute[72818]:   <source dev="/dev/sdh"/>
Aug 17 21:17:50 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:17:50 user nova-compute[72818]:   <serial>68084487-5b53-4ac7-b805-96652c359659</serial>
Aug 17 21:17:50 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:17:50 user nova-compute[72818]: </disk>
Aug 17 21:17:50 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] Acquiring lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.utils [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ee4add-1b22-4d68-8ce6-f616a74c50c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad87895-0df0-4ab9-9a52-b59d7f22b962]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17d7242-63d4-4a35-aa83-66a9aeace6c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c49079-c141-45fd-9eb1-410280c66429]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:51 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9453bbb-0c3b-496b-a699-9760c35ab410]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.utils [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7af4be32-70ed-45f5-b20b-8ed89d8bb83e tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] volume_snapshot_create: create_info: {'snapshot_id': '404267eb-2e33-44a8-976c-733fbd6be80a', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72818) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692307071.5109174, b93c6b2f-59ee-4e7f-9805-97ef627eccdb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b93c6b2f-59ee-4e7f-9805-97ef627eccdb {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:17:51 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Successfully detached device vdb from instance b93c6b2f-59ee-4e7f-9805-97ef627eccdb from the live domain config.
Aug 17 21:17:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7af4be32-70ed-45f5-b20b-8ed89d8bb83e tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] snap xml: <domainsnapshot>
Aug 17 21:17:51 user nova-compute[72818]:   <disks>
Aug 17 21:17:51 user nova-compute[72818]:     <disk name="/dev/sdj" snapshot="external" type="file">
Aug 17 21:17:51 user nova-compute[72818]:       <source file="/dev/new_file"/>
Aug 17 21:17:51 user nova-compute[72818]:     </disk>
Aug 17 21:17:51 user nova-compute[72818]:     <disk name="vda" snapshot="no"/>
Aug 17 21:17:51 user nova-compute[72818]:   </disks>
Aug 17 21:17:51 user nova-compute[72818]: </domainsnapshot>
Aug 17 21:17:51 user nova-compute[72818]:  {{(pid=72818) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7af4be32-70ed-45f5-b20b-8ed89d8bb83e tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lazy-loading 'system_metadata' on Instance uuid 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujNofVtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:51 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8041a4d2-d028-4f0e-be7e-0bdca00fa96c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8bbd39e7-d63b-42aa-bd9b-c891eba9db38 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] volume_snapshot_delete: delete_info: {'volume_id': 'b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd'} {{(pid=72818) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [None req-8bbd39e7-d63b-42aa-bd9b-c891eba9db38 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Traceback (most recent call last):
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     if delete_info['type'] != 'qcow2':
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] KeyError: 'type'
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] 
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ce5d30-3f18-48da-b367-a0b3c13fc5b0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)
Aug 17 21:17:51 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:51 user nova-compute[72818]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 (non-flash)
Aug 17 21:17:51 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f28593250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659'): ({'sdh'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Removing single pathed devices sdh {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-7af4be32-70ed-45f5-b20b-8ed89d8bb83e tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [None req-7af4be32-70ed-45f5-b20b-8ed89d8bb83e tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Traceback (most recent call last):
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     rv = execute(f, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     six.reraise(c, e, tb)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     raise value
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     rv = meth(*args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] 
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [None req-7af4be32-70ed-45f5-b20b-8ed89d8bb83e tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Traceback (most recent call last):
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     self._volume_snapshot_create(context, instance, guest,
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     rv = execute(f, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     six.reraise(c, e, tb)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     raise value
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     rv = meth(*args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] 
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1aec09-ebf5-4ef6-970f-c70a2e02e56e]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json" returned: 0 in 0.364s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c382297d-7644-4a84-84f2-06170825db81]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Flushing IO for device /dev/sdh {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89567d5-de9b-4094-9f6a-93addbe795e1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:17:51 user nova-compute[72818]: INFO nova.compute.manager [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Swapping volume 24964e89-33fc-4294-8db4-9db93143d744 for 8aa32d2b-12a0-47bf-bd91-7a7466883ef6
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [None req-8bbd39e7-d63b-42aa-bd9b-c891eba9db38 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver 
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver 
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-499ff893-88da-49af-9c0a-578257819918)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver 
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver 
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver 
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server [None req-8bbd39e7-d63b-42aa-bd9b-c891eba9db38 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Exception during message handling: KeyError: 'type'
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server 
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[773fc19a-80cf-4fd9-a21a-4b7d9a393bda]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver [None req-7af4be32-70ed-45f5-b20b-8ed89d8bb83e tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 404267eb-2e33-44a8-976c-733fbd6be80a could not be found.
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     raise value
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver 
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver 
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 404267eb-2e33-44a8-976c-733fbd6be80a could not be found. (HTTP 404) (Request-ID: req-a436fcb5-3225-4463-8a01-233c3ba4eb8a)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver 
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver 
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 404267eb-2e33-44a8-976c-733fbd6be80a could not be found.
Aug 17 21:17:51 user nova-compute[72818]: ERROR nova.virt.libvirt.driver 
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] SCSI volumes sdh have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:17:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server [None req-7af4be32-70ed-45f5-b20b-8ed89d8bb83e tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise value
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 21:17:51 user nova-compute[72818]: ERROR oslo_messaging.rpc.server 
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cb25cf-2747-4054-b67c-3579fdafa508]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[164ac5fc-dfc8-41b1-8c4a-e54a23f22f5f]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659, portal: 172.16.0.220,3260]
Aug 17 21:17:52 user nova-compute[72818]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659, portal: 172.16.0.220,3260] successful.
Aug 17 21:17:52 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[22816e75-30c9-4b5f-a85b-be34b7894538]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.593s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] <== disconnect_volume: return (596ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:17:52 user nova-compute[72818]: INFO nova.compute.claims [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Claim successful on node user
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG nova.network.neutron [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:17:53 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:17:53 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:53 user nova-compute[72818]: DEBUG nova.policy [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44662762d7924c16aaa0dfa5c38e5983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3427d284fd1446f8b7144adeef980549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:17:54 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Creating image(s)
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "/opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "/opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:54 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:17:54 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7372MB free_disk=25.654823303222656GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.228s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b93c6b2f-59ee-4e7f-9805-97ef627eccdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 796d2c15-1728-4cd2-a325-e9385556050f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance a4618087-b551-4cc4-b50e-5276bb8395cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 279a0c9c-91a3-4c5b-8918-b1a9278b59ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b4a54471-2c50-435f-8e78-e5cdd1b41093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.199s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk 1073741824" returned: 0 in 0.065s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEAuPdzo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:54 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:54 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:54 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0441523-2766-4612-af99-70b5c68c2f7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:17:54 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4587e4c6-a09f-4902-b284-03dcd7cee19f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f] added
Aug 17 21:17:54 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79748ed-be6a-4ae8-b81c-8477396f8b96]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c7f2fe-7fe9-410f-8224-44ea49573c31]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEAuPdzo {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEAuPdzo" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9970100f-b763-4a4f-867b-c5606d34c15a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kEAuPdzo'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.231s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b1d256-a1ac-480d-93da-02fe24c38ca6]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc70a866-68e0-402e-96e5-bc78d8165933]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.869s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqJElxwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:55 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --login" returned: 0 in 0.121s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cb90ba-0481-4a5f-aa86-a948cd8e9553]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f, portal: 172.16.0.220,3260]
Aug 17 21:17:55 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f, portal: 172.16.0.220,3260] successful.
Aug 17 21:17:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Cannot resize image /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.objects.instance [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lazy-loading 'migration_context' on Instance uuid b4a54471-2c50-435f-8e78-e5cdd1b41093 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[735e16a7-7cf9-4c90-87bf-8fbaa54b0eaa]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Ensure instance console log exists: /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe367e7d-8a91-4c22-89e4-07d6d3dd5cb7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:55 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.440s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfb891a-1229-4b8b-a5ec-ba5ca5032fca]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEAuPdzo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Acquiring lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:55 user nova-compute[72818]: INFO nova.compute.manager [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Detaching volume b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.network.neutron [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Successfully created port: 736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:17:55 user nova-compute[72818]: INFO nova.virt.block_device [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Attempting to driver detach volume b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd from mountpoint /dev/vdb
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Attempting to detach device vdb from instance 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 21:17:55 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:55 user nova-compute[72818]:   <source dev="/dev/sdj"/>
Aug 17 21:17:55 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:17:55 user nova-compute[72818]:   <serial>b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd</serial>
Aug 17 21:17:55 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:17:55 user nova-compute[72818]: </disk>
Aug 17 21:17:55 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:17:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Successfully detached device vdb from instance 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 from the persistent domain config.
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 21:17:55 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:55 user nova-compute[72818]:   <source dev="/dev/sdj"/>
Aug 17 21:17:55 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:17:55 user nova-compute[72818]:   <serial>b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd</serial>
Aug 17 21:17:55 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:17:55 user nova-compute[72818]: </disk>
Aug 17 21:17:55 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.utils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79b6095-1aae-463d-b0fb-f44e213e48f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[47059c47-f77b-4f61-b963-e579c49bc3eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c004c8-ce24-465d-afbe-b5bea2a6b3b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad28a8b8-fd91-475d-83bd-96e53f814e47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:17:55 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:17:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e512c8-4a3c-41b8-a6df-c2c452efd9df]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG os_brick.utils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:55 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Updating existing volume attachment record: 81779d39-d768-4c20-9bdd-59cfd0e7d59c {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.volume.cinder [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] Update attachment failed for attachment 4d2e67b1-3324-4ca1-9cb4-a203b906286e. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:8aa32d2b-12a0-47bf-bd91-7a7466883ef6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 17 21:17:56 user nova-compute[72818]: Collecting current configuration:
Aug 17 21:17:56 user nova-compute[72818]: FATAL: Received the following error:
Aug 17 21:17:56 user nova-compute[72818]:         groups(): Target 'iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659' is not available
Aug 17 21:17:56 user nova-compute[72818]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:8aa32d2b-12a0-47bf-bd91-7a7466883ef6 -driver iscsi -attributes IncomingUser=LesaoOlIngSeSslEs e7oN7ZSkTJNYLXXV -noprompt...).). (HTTP 500) (Request-ID: req-74ffd295-8e6e-4841-a2d8-d87281057da3) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:8aa32d2b-12a0-47bf-bd91-7a7466883ef6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error: 
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Failed to connect to volume 8aa32d2b-12a0-47bf-bd91-7a7466883ef6 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:8aa32d2b-12a0-47bf-bd91-7a7466883ef6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 17 21:17:56 user nova-compute[72818]: Collecting current configuration:
Aug 17 21:17:56 user nova-compute[72818]: FATAL: Received the following error:
Aug 17 21:17:56 user nova-compute[72818]:         groups(): Target 'iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659' is not available
Aug 17 21:17:56 user nova-compute[72818]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:8aa32d2b-12a0-47bf-bd91-7a7466883ef6 -driver iscsi -attributes IncomingUser=LesaoOlIngSeSslEs e7oN7ZSkTJNYLXXV -noprompt...).). (HTTP 500) (Request-ID: req-74ffd295-8e6e-4841-a2d8-d87281057da3)
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Traceback (most recent call last):
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     old_cinfo, new_cinfo = self._init_volume_connection(
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     new_cinfo = self.volume_api.attachment_update(
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     res = method(self, ctx, *args, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     with excutils.save_and_reraise_exception():
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     self.force_reraise()
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     raise self.value
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     return method.func(obj, *args, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     resp = self._update('/attachments/%s' % id, body)
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     return self.request(url, method, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]     raise exceptions.from_response(resp, body)
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:8aa32d2b-12a0-47bf-bd91-7a7466883ef6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Collecting current configuration:
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] 
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] FATAL: Received the following error:
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] 
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532]         groups(): Target 'iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659' is not available
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] 
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:8aa32d2b-12a0-47bf-bd91-7a7466883ef6 -driver iscsi -attributes IncomingUser=LesaoOlIngSeSslEs e7oN7ZSkTJNYLXXV -noprompt...).). (HTTP 500) (Request-ID: req-74ffd295-8e6e-4841-a2d8-d87281057da3)
Aug 17 21:17:56 user nova-compute[72818]: ERROR nova.compute.manager [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] 
Aug 17 21:17:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.objects.instance [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lazy-loading 'flavor' on Instance uuid b93c6b2f-59ee-4e7f-9805-97ef627eccdb {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91ded6b0-2f0c-4a85-8797-676afb9d99bb tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.463s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 5.041s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server [None req-e9203b6b-6c58-412f-969b-c21e51b6eacd tempest-TestVolumeSwap-323867678 tempest-TestVolumeSwap-323867678-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:8aa32d2b-12a0-47bf-bd91-7a7466883ef6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 17 21:17:56 user nova-compute[72818]: Collecting current configuration:
Aug 17 21:17:56 user nova-compute[72818]: FATAL: Received the following error:
Aug 17 21:17:56 user nova-compute[72818]:         groups(): Target 'iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659' is not available
Aug 17 21:17:56 user nova-compute[72818]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:8aa32d2b-12a0-47bf-bd91-7a7466883ef6 -driver iscsi -attributes IncomingUser=LesaoOlIngSeSslEs e7oN7ZSkTJNYLXXV -noprompt...).). (HTTP 500) (Request-ID: req-74ffd295-8e6e-4841-a2d8-d87281057da3)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7823, in swap_volume
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7821, in _do_locked_swap_volume
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7865, in _do_swap_volume
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7714, in _swap_volume
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:8aa32d2b-12a0-47bf-bd91-7a7466883ef6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server Collecting current configuration:
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server 
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server FATAL: Received the following error:
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server 
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server         groups(): Target 'iqn.2010-10.org.openstack:68084487-5b53-4ac7-b805-96652c359659' is not available
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server 
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:8aa32d2b-12a0-47bf-bd91-7a7466883ef6 -driver iscsi -attributes IncomingUser=LesaoOlIngSeSslEs e7oN7ZSkTJNYLXXV -noprompt...).). (HTTP 500) (Request-ID: req-74ffd295-8e6e-4841-a2d8-d87281057da3)
Aug 17 21:17:56 user nova-compute[72818]: ERROR oslo_messaging.rpc.server 
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692307076.3312259, 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:17:56 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Successfully detached device vdb from instance 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 from the live domain config.
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYqcWyEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:56 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.492s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '26637353334396635', 'path': '/dev/sdh'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637353334396635', 'path': '/dev/sdh'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.138s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:56 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:56 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.objects.instance [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lazy-loading 'flavor' on Instance uuid 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d02002-c58b-4a31-96ba-35d47192b689]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:17:56 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:17:56 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:56 user nova-compute[72818]:   <source dev="/dev/sdh"/>
Aug 17 21:17:56 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:17:56 user nova-compute[72818]:   <serial>d829af72-a52e-46bb-bc5b-035eefcb738f</serial>
Aug 17 21:17:56 user nova-compute[72818]: </disk>
Aug 17 21:17:56 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[17562f24-2f3f-4b00-b207-c481c782e502]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb] added
Aug 17 21:17:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caa23d9-f175-4b80-b664-6d9e1936988c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[445d798f-ea6b-401c-beb8-39bc3dec347a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqJElxwf {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqJElxwf" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65dd885-e430-49f1-9452-a300431bd338]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BqJElxwf'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.network.neutron [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Successfully updated port: 736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfddf32-a26d-4ebc-8b45-ec5cb7120e2b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "refresh_cache-b4a54471-2c50-435f-8e78-e5cdd1b41093" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquired lock "refresh_cache-b4a54471-2c50-435f-8e78-e5cdd1b41093" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.network.neutron [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6223c559-921b-49f8-b995-659717d35f3c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-9ec1372c-84e9-46d0-b397-5d7d30b029f8 req-e4ea5fbd-fa11-4328-a049-6665f5a5d19f service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Received event network-changed-736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-9ec1372c-84e9-46d0-b397-5d7d30b029f8 req-e4ea5fbd-fa11-4328-a049-6665f5a5d19f service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Refreshing instance network info cache due to event network-changed-736f010d-ebe7-49fc-846d-1e12845ecb81. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9ec1372c-84e9-46d0-b397-5d7d30b029f8 req-e4ea5fbd-fa11-4328-a049-6665f5a5d19f service nova] Acquiring lock "refresh_cache-b4a54471-2c50-435f-8e78-e5cdd1b41093" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.network.neutron [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8431f136-a9df-45c7-b57a-a28bfcb33345]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb, portal: 172.16.0.220,3260]
Aug 17 21:17:56 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb, portal: 172.16.0.220,3260] successful.
Aug 17 21:17:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e58fca-2b5c-4de3-af11-020b37c82694]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[77805202-3c66-47b4-8c9f-1770c7d60b90]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:56 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f2167c-5b8a-4633-8a9f-5289ff281a98]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqJElxwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] No BDM found with device name hda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] No VIF found with MAC fa:16:3e:1c:94:f9, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:56 user nova-compute[72818]: DEBUG nova.network.neutron [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Updating instance_info_cache with network_info: [{"id": "736f010d-ebe7-49fc-846d-1e12845ecb81", "address": "fa:16:3e:71:ff:2d", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736f010d-eb", "ovs_interfaceid": "736f010d-ebe7-49fc-846d-1e12845ecb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Releasing lock "refresh_cache-b4a54471-2c50-435f-8e78-e5cdd1b41093" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Instance network_info: |[{"id": "736f010d-ebe7-49fc-846d-1e12845ecb81", "address": "fa:16:3e:71:ff:2d", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736f010d-eb", "ovs_interfaceid": "736f010d-ebe7-49fc-846d-1e12845ecb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9ec1372c-84e9-46d0-b397-5d7d30b029f8 req-e4ea5fbd-fa11-4328-a049-6665f5a5d19f service nova] Acquired lock "refresh_cache-b4a54471-2c50-435f-8e78-e5cdd1b41093" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.network.neutron [req-9ec1372c-84e9-46d0-b397-5d7d30b029f8 req-e4ea5fbd-fa11-4328-a049-6665f5a5d19f service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Refreshing network info cache for port 736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Start _get_guest_xml network_info=[{"id": "736f010d-ebe7-49fc-846d-1e12845ecb81", "address": "fa:16:3e:71:ff:2d", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736f010d-eb", "ovs_interfaceid": "736f010d-ebe7-49fc-846d-1e12845ecb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:17:57 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:17:57 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:17:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-778019218',display_name='tempest-VolumesSnapshotTestJSON-instance-778019218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-778019218',id=12,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqeHsIbDwZLoNy36zYEst+y94zqRdY0yIyWVAqU8lLu9W7cpN6M+1E78gHlV72uDTZ7RjxU01jOH4sozk4TeLYphkBgk8QQQ6oCpATOy5aSW9KIp6PeivBA3b9kbUQV4A==',key_name='tempest-keypair-1313671370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3427d284fd1446f8b7144adeef980549',ramdisk_id='',reservation_id='r-hr9u84yx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-473153764',owner_user_name='tempest-VolumesSnapshotTestJSON-473153764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44662762d7924c16aaa0dfa5c38e5983',uuid=b4a54471-2c50-435f-8e78-e5cdd1b41093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "736f010d-ebe7-49fc-846d-1e12845ecb81", "address": "fa:16:3e:71:ff:2d", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736f010d-eb", "ovs_interfaceid": "736f010d-ebe7-49fc-846d-1e12845ecb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Converting VIF {"id": "736f010d-ebe7-49fc-846d-1e12845ecb81", "address": "fa:16:3e:71:ff:2d", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736f010d-eb", "ovs_interfaceid": "736f010d-ebe7-49fc-846d-1e12845ecb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ff:2d,bridge_name='br-int',has_traffic_filtering=True,id=736f010d-ebe7-49fc-846d-1e12845ecb81,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736f010d-eb') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.objects.instance [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lazy-loading 'pci_devices' on Instance uuid b4a54471-2c50-435f-8e78-e5cdd1b41093 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:17:57 user nova-compute[72818]:   <uuid>b4a54471-2c50-435f-8e78-e5cdd1b41093</uuid>
Aug 17 21:17:57 user nova-compute[72818]:   <name>instance-0000000c</name>
Aug 17 21:17:57 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:17:57 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:17:57 user nova-compute[72818]:   <metadata>
Aug 17 21:17:57 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:17:57 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:17:57 user nova-compute[72818]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-778019218</nova:name>
Aug 17 21:17:57 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:17:57</nova:creationTime>
Aug 17 21:17:57 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:17:57 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:17:57 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:17:57 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:17:57 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:17:57 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:17:57 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:17:57 user nova-compute[72818]:       <nova:owner>
Aug 17 21:17:57 user nova-compute[72818]:         <nova:user uuid="44662762d7924c16aaa0dfa5c38e5983">tempest-VolumesSnapshotTestJSON-473153764-project-member</nova:user>
Aug 17 21:17:57 user nova-compute[72818]:         <nova:project uuid="3427d284fd1446f8b7144adeef980549">tempest-VolumesSnapshotTestJSON-473153764</nova:project>
Aug 17 21:17:57 user nova-compute[72818]:       </nova:owner>
Aug 17 21:17:57 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:17:57 user nova-compute[72818]:       <nova:ports>
Aug 17 21:17:57 user nova-compute[72818]:         <nova:port uuid="736f010d-ebe7-49fc-846d-1e12845ecb81">
Aug 17 21:17:57 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 21:17:57 user nova-compute[72818]:         </nova:port>
Aug 17 21:17:57 user nova-compute[72818]:       </nova:ports>
Aug 17 21:17:57 user nova-compute[72818]:     </nova:instance>
Aug 17 21:17:57 user nova-compute[72818]:   </metadata>
Aug 17 21:17:57 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:17:57 user nova-compute[72818]:     <system>
Aug 17 21:17:57 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:17:57 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:17:57 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:17:57 user nova-compute[72818]:       <entry name="serial">b4a54471-2c50-435f-8e78-e5cdd1b41093</entry>
Aug 17 21:17:57 user nova-compute[72818]:       <entry name="uuid">b4a54471-2c50-435f-8e78-e5cdd1b41093</entry>
Aug 17 21:17:57 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:17:57 user nova-compute[72818]:     </system>
Aug 17 21:17:57 user nova-compute[72818]:   </sysinfo>
Aug 17 21:17:57 user nova-compute[72818]:   <os>
Aug 17 21:17:57 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:17:57 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:17:57 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:17:57 user nova-compute[72818]:   </os>
Aug 17 21:17:57 user nova-compute[72818]:   <features>
Aug 17 21:17:57 user nova-compute[72818]:     <acpi/>
Aug 17 21:17:57 user nova-compute[72818]:     <apic/>
Aug 17 21:17:57 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:17:57 user nova-compute[72818]:   </features>
Aug 17 21:17:57 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:17:57 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:17:57 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:17:57 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:17:57 user nova-compute[72818]:   </clock>
Aug 17 21:17:57 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:17:57 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:17:57 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:17:57 user nova-compute[72818]:   </cpu>
Aug 17 21:17:57 user nova-compute[72818]:   <devices>
Aug 17 21:17:57 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:17:57 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:17:57 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk"/>
Aug 17 21:17:57 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:17:57 user nova-compute[72818]:     </disk>
Aug 17 21:17:57 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:17:57 user nova-compute[72818]:       <mac address="fa:16:3e:71:ff:2d"/>
Aug 17 21:17:57 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:57 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:17:57 user nova-compute[72818]:       <target dev="tap736f010d-eb"/>
Aug 17 21:17:57 user nova-compute[72818]:     </interface>
Aug 17 21:17:57 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:17:57 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/console.log" append="off"/>
Aug 17 21:17:57 user nova-compute[72818]:     </serial>
Aug 17 21:17:57 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:17:57 user nova-compute[72818]:     <video>
Aug 17 21:17:57 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:17:57 user nova-compute[72818]:     </video>
Aug 17 21:17:57 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:17:57 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:17:57 user nova-compute[72818]:     </rng>
Aug 17 21:17:57 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:17:57 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:17:57 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:17:57 user nova-compute[72818]:     </memballoon>
Aug 17 21:17:57 user nova-compute[72818]:   </devices>
Aug 17 21:17:57 user nova-compute[72818]: </domain>
Aug 17 21:17:57 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:17:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-778019218',display_name='tempest-VolumesSnapshotTestJSON-instance-778019218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-778019218',id=12,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqeHsIbDwZLoNy36zYEst+y94zqRdY0yIyWVAqU8lLu9W7cpN6M+1E78gHlV72uDTZ7RjxU01jOH4sozk4TeLYphkBgk8QQQ6oCpATOy5aSW9KIp6PeivBA3b9kbUQV4A==',key_name='tempest-keypair-1313671370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3427d284fd1446f8b7144adeef980549',ramdisk_id='',reservation_id='r-hr9u84yx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-473153764',owner_user_name='tempest-VolumesSnapshotTestJSON-473153764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44662762d7924c16aaa0dfa5c38e5983',uuid=b4a54471-2c50-435f-8e78-e5cdd1b41093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "736f010d-ebe7-49fc-846d-1e12845ecb81", "address": "fa:16:3e:71:ff:2d", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736f010d-eb", "ovs_interfaceid": "736f010d-ebe7-49fc-846d-1e12845ecb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Converting VIF {"id": "736f010d-ebe7-49fc-846d-1e12845ecb81", "address": "fa:16:3e:71:ff:2d", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736f010d-eb", "ovs_interfaceid": "736f010d-ebe7-49fc-846d-1e12845ecb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ff:2d,bridge_name='br-int',has_traffic_filtering=True,id=736f010d-ebe7-49fc-846d-1e12845ecb81,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736f010d-eb') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG os_vif [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ff:2d,bridge_name='br-int',has_traffic_filtering=True,id=736f010d-ebe7-49fc-846d-1e12845ecb81,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736f010d-eb') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-efb7b0c1-93a3-4d96-b617-4c7b8fab8588 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "796d2c15-1728-4cd2-a325-e9385556050f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.461s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap736f010d-eb, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap736f010d-eb, col_values=(('external_ids', {'iface-id': '736f010d-ebe7-49fc-846d-1e12845ecb81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:ff:2d', 'vm-uuid': 'b4a54471-2c50-435f-8e78-e5cdd1b41093'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:57 user nova-compute[72818]: INFO os_vif [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ff:2d,bridge_name='br-int',has_traffic_filtering=True,id=736f010d-ebe7-49fc-846d-1e12845ecb81,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736f010d-eb')
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] No VIF found with MAC fa:16:3e:71:ff:2d, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.network.neutron [req-9ec1372c-84e9-46d0-b397-5d7d30b029f8 req-e4ea5fbd-fa11-4328-a049-6665f5a5d19f service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Updated VIF entry in instance network info cache for port 736f010d-ebe7-49fc-846d-1e12845ecb81. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.network.neutron [req-9ec1372c-84e9-46d0-b397-5d7d30b029f8 req-e4ea5fbd-fa11-4328-a049-6665f5a5d19f service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Updating instance_info_cache with network_info: [{"id": "736f010d-ebe7-49fc-846d-1e12845ecb81", "address": "fa:16:3e:71:ff:2d", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736f010d-eb", "ovs_interfaceid": "736f010d-ebe7-49fc-846d-1e12845ecb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9ec1372c-84e9-46d0-b397-5d7d30b029f8 req-e4ea5fbd-fa11-4328-a049-6665f5a5d19f service nova] Releasing lock "refresh_cache-b4a54471-2c50-435f-8e78-e5cdd1b41093" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] <== connect_volume: return (2571ms) {'type': 'block', 'scsi_wwn': '23431353433326635', 'path': '/dev/sdk'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431353433326635', 'path': '/dev/sdk'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.495s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.objects.instance [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lazy-loading 'flavor' on Instance uuid e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9be5ff-9756-4608-be72-fba6b4f7a4c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:17:57 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:57 user nova-compute[72818]:   <source dev="/dev/sdk"/>
Aug 17 21:17:57 user nova-compute[72818]:   <target dev="sdc" bus="scsi"/>
Aug 17 21:17:57 user nova-compute[72818]:   <serial>1844d539-e63c-4895-8b38-86ba8d7fbddb</serial>
Aug 17 21:17:57 user nova-compute[72818]:   <address type="drive" controller="0" unit="2"/>
Aug 17 21:17:57 user nova-compute[72818]: </disk>
Aug 17 21:17:57 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cbdbc6-a6f6-4128-9990-991bdfe0731f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:57 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:57 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:57 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f2860f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd'): ({'sdj'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Removing single pathed devices sdj {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a59813-144e-41a8-8765-e27421f7a506]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0aab62-a81a-4f1e-9b92-43170c62028e]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Flushing IO for device /dev/sdj {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2cda50-d932-40ec-87cf-61be0daad99b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:57 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.040s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[451166d6-339e-405f-9b0b-bb23d678016d]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] SCSI volumes sdj have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0605f56d-5594-4819-ac80-9734c7b63cb9]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4873d779-4b0d-401c-b6f4-ffacf5b9ac27]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd, portal: 172.16.0.220,3260]
Aug 17 21:17:58 user nova-compute[72818]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd, portal: 172.16.0.220,3260] successful.
Aug 17 21:17:58 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a3f3ca-2e83-4b2c-ba37-1968f83a90bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[082e3fb8-40ee-486d-aca9-fdfa2014e3a2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] <== disconnect_volume: return (1877ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "796d2c15-1728-4cd2-a325-e9385556050f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:58 user nova-compute[72818]: INFO nova.compute.manager [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Detaching volume d829af72-a52e-46bb-bc5b-035eefcb738f
Aug 17 21:17:58 user nova-compute[72818]: INFO nova.virt.block_device [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Attempting to driver detach volume d829af72-a52e-46bb-bc5b-035eefcb738f from mountpoint /dev/vdb
Aug 17 21:17:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Attempting to detach device vdb from instance 796d2c15-1728-4cd2-a325-e9385556050f from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:17:58 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:58 user nova-compute[72818]:   <source dev="/dev/sdh"/>
Aug 17 21:17:58 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:17:58 user nova-compute[72818]:   <serial>d829af72-a52e-46bb-bc5b-035eefcb738f</serial>
Aug 17 21:17:58 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 21:17:58 user nova-compute[72818]: </disk>
Aug 17 21:17:58 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:17:58 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Successfully detached device vdb from instance 796d2c15-1728-4cd2-a325-e9385556050f from the persistent domain config.
Aug 17 21:17:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 796d2c15-1728-4cd2-a325-e9385556050f from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:17:58 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:17:58 user nova-compute[72818]:   <source dev="/dev/sdh"/>
Aug 17 21:17:58 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:17:58 user nova-compute[72818]:   <serial>d829af72-a52e-46bb-bc5b-035eefcb738f</serial>
Aug 17 21:17:58 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 21:17:58 user nova-compute[72818]: </disk>
Aug 17 21:17:58 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] No BDM found with device name sda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:17:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] No VIF found with MAC fa:16:3e:8d:f2:92, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-291007f5-5eca-4767-87ab-fe8f0d4d5511 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.156s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG nova.objects.instance [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lazy-loading 'flavor' on Instance uuid 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-d7efc7dd-2fb1-47d1-a093-30651ea84f8b req-3dab1478-c632-4d08-a153-2334e8a7e033 service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Received event network-vif-plugged-736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d7efc7dd-2fb1-47d1-a093-30651ea84f8b req-3dab1478-c632-4d08-a153-2334e8a7e033 service nova] Acquiring lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d7efc7dd-2fb1-47d1-a093-30651ea84f8b req-3dab1478-c632-4d08-a153-2334e8a7e033 service nova] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d7efc7dd-2fb1-47d1-a093-30651ea84f8b req-3dab1478-c632-4d08-a153-2334e8a7e033 service nova] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-d7efc7dd-2fb1-47d1-a093-30651ea84f8b req-3dab1478-c632-4d08-a153-2334e8a7e033 service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] No waiting events found dispatching network-vif-plugged-736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:17:59 user nova-compute[72818]: WARNING nova.compute.manager [req-d7efc7dd-2fb1-47d1-a093-30651ea84f8b req-3dab1478-c632-4d08-a153-2334e8a7e033 service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Received unexpected event network-vif-plugged-736f010d-ebe7-49fc-846d-1e12845ecb81 for instance with vm_state building and task_state spawning.
Aug 17 21:17:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692307079.4259422, 796d2c15-1728-4cd2-a325-e9385556050f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:17:59 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Successfully detached device vdb from instance 796d2c15-1728-4cd2-a325-e9385556050f from the live domain config.
Aug 17 21:17:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEAuPdzo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:17:59 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7573201-1178-41f7-907b-5b31835918c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-83667d5e-db6d-401c-9246-102130138d53 tempest-VolumesAssistedSnapshotsTest-1640812488 tempest-VolumesAssistedSnapshotsTest-1640812488-project-admin] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.874s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb35e7a-12b2-4009-abd7-c7a0b0a96e14]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:17:59 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:17:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f28538dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f'): ({'sdh'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Removing single pathed devices sdh {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f919ac63-9a2a-4dd0-bfcd-038be14b114b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a919a0-2bb7-4592-be59-7bf575dab81f]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Flushing IO for device /dev/sdh {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca5279c-72ce-4dcf-b007-36e830a1e904]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[95085b14-8e95-42cf-b16d-d6d275027ffa]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] SCSI volumes sdh have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de8a80b-7b47-4695-8a77-d989d7bf5899]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0bb1d0-920f-4e15-b932-9bd6b417efc9]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f, portal: 172.16.0.220,3260]
Aug 17 21:17:59 user nova-compute[72818]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f, portal: 172.16.0.220,3260] successful.
Aug 17 21:17:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d829af72-a52e-46bb-bc5b-035eefcb738f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[596340c1-f933-408b-8024-1c36d5b32708]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] <== disconnect_volume: return (382ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:17:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:00 user nova-compute[72818]: INFO nova.compute.manager [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Detaching volume 1844d539-e63c-4895-8b38-86ba8d7fbddb
Aug 17 21:18:00 user nova-compute[72818]: INFO nova.virt.block_device [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Attempting to driver detach volume 1844d539-e63c-4895-8b38-86ba8d7fbddb from mountpoint /dev/sdc
Aug 17 21:18:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Attempting to detach device sdc from instance e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:18:00 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:18:00 user nova-compute[72818]:   <source dev="/dev/sdk"/>
Aug 17 21:18:00 user nova-compute[72818]:   <target dev="sdc" bus="scsi"/>
Aug 17 21:18:00 user nova-compute[72818]:   <serial>1844d539-e63c-4895-8b38-86ba8d7fbddb</serial>
Aug 17 21:18:00 user nova-compute[72818]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 21:18:00 user nova-compute[72818]: </disk>
Aug 17 21:18:00 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:18:00 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Successfully detached device sdc from instance e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 from the persistent domain config.
Aug 17 21:18:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:18:00 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:18:00 user nova-compute[72818]:   <source dev="/dev/sdk"/>
Aug 17 21:18:00 user nova-compute[72818]:   <target dev="sdc" bus="scsi"/>
Aug 17 21:18:00 user nova-compute[72818]:   <serial>1844d539-e63c-4895-8b38-86ba8d7fbddb</serial>
Aug 17 21:18:00 user nova-compute[72818]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 21:18:00 user nova-compute[72818]: </disk>
Aug 17 21:18:00 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692307080.7654881, e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:18:00 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Successfully detached device sdc from instance e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 from the live domain config.
Aug 17 21:18:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqJElxwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:18:00 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG nova.objects.instance [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lazy-loading 'flavor' on Instance uuid 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5d05ab-63e3-46f7-a34a-cacee9c8a2ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ce1b56-1f32-4d3e-a893-e2830f6c5fc7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:18:00 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:18:00 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:18:00 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fa8430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb'): ({'sdk'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Removing single pathed devices sdk {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcea1e9-6f44-4fde-b901-6642e686c8d7]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cf45e4f8-4576-49b5-8190-11f1d6a93c28 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "796d2c15-1728-4cd2-a325-e9385556050f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.491s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.038s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[484258bd-284d-451e-ba17-7be5d237569d]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Flushing IO for device /dev/sdk {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ff161f-1fa0-4c97-bbba-92be1fc02123]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.045s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4171cc7-a05a-4e08-bc51-34dde8f348a9]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] SCSI volumes sdk have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:18:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6b35e0-b3ec-4d52-bda3-f8b56a0dcd9e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d888f7de-e531-4987-9301-c011a6e2f037]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb, portal: 172.16.0.220,3260]
Aug 17 21:18:01 user nova-compute[72818]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb, portal: 172.16.0.220,3260] successful.
Aug 17 21:18:01 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1844d539-e63c-4895-8b38-86ba8d7fbddb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2640319c-deb3-4b7c-b7c7-f3a4e39cd28a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] <== disconnect_volume: return (362ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-5bc02098-8b82-46d2-a5b0-b9997dd3c696 req-3a87738a-735b-45ec-bab1-f87740693cf0 service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Received event network-vif-plugged-736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5bc02098-8b82-46d2-a5b0-b9997dd3c696 req-3a87738a-735b-45ec-bab1-f87740693cf0 service nova] Acquiring lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5bc02098-8b82-46d2-a5b0-b9997dd3c696 req-3a87738a-735b-45ec-bab1-f87740693cf0 service nova] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5bc02098-8b82-46d2-a5b0-b9997dd3c696 req-3a87738a-735b-45ec-bab1-f87740693cf0 service nova] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-5bc02098-8b82-46d2-a5b0-b9997dd3c696 req-3a87738a-735b-45ec-bab1-f87740693cf0 service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] No waiting events found dispatching network-vif-plugged-736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:01 user nova-compute[72818]: WARNING nova.compute.manager [req-5bc02098-8b82-46d2-a5b0-b9997dd3c696 req-3a87738a-735b-45ec-bab1-f87740693cf0 service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Received unexpected event network-vif-plugged-736f010d-ebe7-49fc-846d-1e12845ecb81 for instance with vm_state building and task_state spawning.
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "interface-796d2c15-1728-4cd2-a325-e9385556050f-d1fd1d06-a240-4248-bcbd-4ece6691d8a0" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "interface-796d2c15-1728-4cd2-a325-e9385556050f-d1fd1d06-a240-4248-bcbd-4ece6691d8a0" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lazy-loading 'flavor' on Instance uuid 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178282304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178282304',id=4,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkwVGCdlBlVcOiwisZJ2m7rAADqLOL+kywXDgvAwR2qTgTTFDHWjasH/U7eolNcNHdZLXQQor9tYHlFwFKvEPgekkTkSGi0+Q6MQwEnZ2+/phVBP+RILBn2kgk74jej4g==',key_name='tempest-keypair-1982021055',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df7d5f3696b24e6a8c96af89e7316ead',ramdisk_id='',reservation_id='r-3sr5sqxw',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-330612610',owner_user_name='tempest-TaggedAttachmentsTest-330612610-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e7e96b636034002b8994454bc89fdba',uuid=796d2c15-1728-4cd2-a325-e9385556050f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converting VIF {"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9b:5a,bridge_name='br-int',has_traffic_filtering=True,id=d1fd1d06-a240-4248-bcbd-4ece6691d8a0,network=Network(0770b32d-1b12-42fc-84a1-77339ca53fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1fd1d06-a2') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307081.8194575, b4a54471-2c50-435f-8e78-e5cdd1b41093 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:18:01 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] VM Resumed (Lifecycle Event)
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:9b:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1fd1d06-a2"/></interface> {{(pid=72818) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:9b:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1fd1d06-a2"/></interface> {{(pid=72818) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 21:18:01 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Instance spawned successfully.
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Attempting to detach device tapd1fd1d06-a2 from instance 796d2c15-1728-4cd2-a325-e9385556050f from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] detach device xml: <interface type="ethernet">
Aug 17 21:18:01 user nova-compute[72818]:   <mac address="fa:16:3e:9e:9b:5a"/>
Aug 17 21:18:01 user nova-compute[72818]:   <model type="virtio"/>
Aug 17 21:18:01 user nova-compute[72818]:   <mtu size="1442"/>
Aug 17 21:18:01 user nova-compute[72818]:   <target dev="tapd1fd1d06-a2"/>
Aug 17 21:18:01 user nova-compute[72818]: </interface>
Aug 17 21:18:01 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:9b:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1fd1d06-a2"/></interface> {{(pid=72818) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:9b:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1fd1d06-a2"/></interface>not found in domain: <domain type='kvm' id='4'>
Aug 17 21:18:01 user nova-compute[72818]:   <name>instance-00000004</name>
Aug 17 21:18:01 user nova-compute[72818]:   <uuid>796d2c15-1728-4cd2-a325-e9385556050f</uuid>
Aug 17 21:18:01 user nova-compute[72818]:   <metadata>
Aug 17 21:18:01 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:18:01 user nova-compute[72818]:   <nova:package version="0.0.0"/>
Aug 17 21:18:01 user nova-compute[72818]:   <nova:name>tempest-device-tagging-server-178282304</nova:name>
Aug 17 21:18:01 user nova-compute[72818]:   <nova:creationTime>2023-08-17 21:17:27</nova:creationTime>
Aug 17 21:18:01 user nova-compute[72818]:   <nova:flavor name="m1.tiny">
Aug 17 21:18:01 user nova-compute[72818]:     <nova:memory>512</nova:memory>
Aug 17 21:18:01 user nova-compute[72818]:     <nova:disk>1</nova:disk>
Aug 17 21:18:01 user nova-compute[72818]:     <nova:swap>0</nova:swap>
Aug 17 21:18:01 user nova-compute[72818]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:18:01 user nova-compute[72818]:     <nova:vcpus>1</nova:vcpus>
Aug 17 21:18:01 user nova-compute[72818]:   </nova:flavor>
Aug 17 21:18:01 user nova-compute[72818]:   <nova:owner>
Aug 17 21:18:01 user nova-compute[72818]:     <nova:user uuid="0e7e96b636034002b8994454bc89fdba">tempest-TaggedAttachmentsTest-330612610-project-member</nova:user>
Aug 17 21:18:01 user nova-compute[72818]:     <nova:project uuid="df7d5f3696b24e6a8c96af89e7316ead">tempest-TaggedAttachmentsTest-330612610</nova:project>
Aug 17 21:18:01 user nova-compute[72818]:   </nova:owner>
Aug 17 21:18:01 user nova-compute[72818]:   <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:18:01 user nova-compute[72818]:   <nova:ports>
Aug 17 21:18:01 user nova-compute[72818]:     <nova:port uuid="5e1c71f4-af86-4f7a-8dcf-0210699e469b">
Aug 17 21:18:01 user nova-compute[72818]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 21:18:01 user nova-compute[72818]:     </nova:port>
Aug 17 21:18:01 user nova-compute[72818]:     <nova:port uuid="d1fd1d06-a240-4248-bcbd-4ece6691d8a0">
Aug 17 21:18:01 user nova-compute[72818]:       <nova:ip type="fixed" address="10.10.10.137" ipVersion="4"/>
Aug 17 21:18:01 user nova-compute[72818]:     </nova:port>
Aug 17 21:18:01 user nova-compute[72818]:   </nova:ports>
Aug 17 21:18:01 user nova-compute[72818]: </nova:instance>
Aug 17 21:18:01 user nova-compute[72818]:   </metadata>
Aug 17 21:18:01 user nova-compute[72818]:   <memory unit='KiB'>524288</memory>
Aug 17 21:18:01 user nova-compute[72818]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 21:18:01 user nova-compute[72818]:   <vcpu placement='static'>1</vcpu>
Aug 17 21:18:01 user nova-compute[72818]:   <resource>
Aug 17 21:18:01 user nova-compute[72818]:     <partition>/machine</partition>
Aug 17 21:18:01 user nova-compute[72818]:   </resource>
Aug 17 21:18:01 user nova-compute[72818]:   <sysinfo type='smbios'>
Aug 17 21:18:01 user nova-compute[72818]:     <system>
Aug 17 21:18:01 user nova-compute[72818]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 21:18:01 user nova-compute[72818]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 21:18:01 user nova-compute[72818]:       <entry name='version'>0.0.0</entry>
Aug 17 21:18:01 user nova-compute[72818]:       <entry name='serial'>796d2c15-1728-4cd2-a325-e9385556050f</entry>
Aug 17 21:18:01 user nova-compute[72818]:       <entry name='uuid'>796d2c15-1728-4cd2-a325-e9385556050f</entry>
Aug 17 21:18:01 user nova-compute[72818]:       <entry name='family'>Virtual Machine</entry>
Aug 17 21:18:01 user nova-compute[72818]:     </system>
Aug 17 21:18:01 user nova-compute[72818]:   </sysinfo>
Aug 17 21:18:01 user nova-compute[72818]:   <os>
Aug 17 21:18:01 user nova-compute[72818]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 21:18:01 user nova-compute[72818]:     <boot dev='hd'/>
Aug 17 21:18:01 user nova-compute[72818]:     <smbios mode='sysinfo'/>
Aug 17 21:18:01 user nova-compute[72818]:   </os>
Aug 17 21:18:01 user nova-compute[72818]:   <features>
Aug 17 21:18:01 user nova-compute[72818]:     <acpi/>
Aug 17 21:18:01 user nova-compute[72818]:     <apic/>
Aug 17 21:18:01 user nova-compute[72818]:     <vmcoreinfo state='on'/>
Aug 17 21:18:01 user nova-compute[72818]:   </features>
Aug 17 21:18:01 user nova-compute[72818]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 21:18:01 user nova-compute[72818]:     <model fallback='forbid'>Nehalem</model>
Aug 17 21:18:01 user nova-compute[72818]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 21:18:01 user nova-compute[72818]:     <feature policy='require' name='vme'/>
Aug 17 21:18:01 user nova-compute[72818]:     <feature policy='require' name='x2apic'/>
Aug 17 21:18:01 user nova-compute[72818]:     <feature policy='require' name='hypervisor'/>
Aug 17 21:18:01 user nova-compute[72818]:   </cpu>
Aug 17 21:18:01 user nova-compute[72818]:   <clock offset='utc'>
Aug 17 21:18:01 user nova-compute[72818]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 21:18:01 user nova-compute[72818]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 21:18:01 user nova-compute[72818]:     <timer name='hpet' present='no'/>
Aug 17 21:18:01 user nova-compute[72818]:   </clock>
Aug 17 21:18:01 user nova-compute[72818]:   <on_poweroff>destroy</on_poweroff>
Aug 17 21:18:01 user nova-compute[72818]:   <on_reboot>restart</on_reboot>
Aug 17 21:18:01 user nova-compute[72818]:   <on_crash>destroy</on_crash>
Aug 17 21:18:01 user nova-compute[72818]:   <devices>
Aug 17 21:18:01 user nova-compute[72818]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 21:18:01 user nova-compute[72818]:     <disk type='file' device='disk'>
Aug 17 21:18:01 user nova-compute[72818]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 21:18:01 user nova-compute[72818]:       <source file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk' index='2'/>
Aug 17 21:18:01 user nova-compute[72818]:       <backingStore type='file' index='3'>
Aug 17 21:18:01 user nova-compute[72818]:         <format type='raw'/>
Aug 17 21:18:01 user nova-compute[72818]:         <source file='/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35'/>
Aug 17 21:18:01 user nova-compute[72818]:         <backingStore/>
Aug 17 21:18:01 user nova-compute[72818]:       </backingStore>
Aug 17 21:18:01 user nova-compute[72818]:       <target dev='vda' bus='virtio'/>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='virtio-disk0'/>
Aug 17 21:18:01 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 21:18:01 user nova-compute[72818]:     </disk>
Aug 17 21:18:01 user nova-compute[72818]:     <disk type='file' device='cdrom'>
Aug 17 21:18:01 user nova-compute[72818]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 21:18:01 user nova-compute[72818]:       <source file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk.config' index='1'/>
Aug 17 21:18:01 user nova-compute[72818]:       <backingStore/>
Aug 17 21:18:01 user nova-compute[72818]:       <target dev='hda' bus='ide'/>
Aug 17 21:18:01 user nova-compute[72818]:       <readonly/>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='ide0-0-0'/>
Aug 17 21:18:01 user nova-compute[72818]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 21:18:01 user nova-compute[72818]:     </disk>
Aug 17 21:18:01 user nova-compute[72818]:     <controller type='usb' index='0' model='none'>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='usb'/>
Aug 17 21:18:01 user nova-compute[72818]:     </controller>
Aug 17 21:18:01 user nova-compute[72818]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='pci.0'/>
Aug 17 21:18:01 user nova-compute[72818]:     </controller>
Aug 17 21:18:01 user nova-compute[72818]:     <controller type='ide' index='0'>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='ide'/>
Aug 17 21:18:01 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 21:18:01 user nova-compute[72818]:     </controller>
Aug 17 21:18:01 user nova-compute[72818]:     <interface type='ethernet'>
Aug 17 21:18:01 user nova-compute[72818]:       <mac address='fa:16:3e:1c:94:f9'/>
Aug 17 21:18:01 user nova-compute[72818]:       <target dev='tap5e1c71f4-af'/>
Aug 17 21:18:01 user nova-compute[72818]:       <model type='virtio'/>
Aug 17 21:18:01 user nova-compute[72818]:       <mtu size='1442'/>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='net0'/>
Aug 17 21:18:01 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 21:18:01 user nova-compute[72818]:     </interface>
Aug 17 21:18:01 user nova-compute[72818]:     <interface type='ethernet'>
Aug 17 21:18:01 user nova-compute[72818]:       <mac address='fa:16:3e:9e:9b:5a'/>
Aug 17 21:18:01 user nova-compute[72818]:       <target dev='tapd1fd1d06-a2'/>
Aug 17 21:18:01 user nova-compute[72818]:       <model type='virtio'/>
Aug 17 21:18:01 user nova-compute[72818]:       <mtu size='1442'/>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='net1'/>
Aug 17 21:18:01 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 17 21:18:01 user nova-compute[72818]:     </interface>
Aug 17 21:18:01 user nova-compute[72818]:     <serial type='pty'>
Aug 17 21:18:01 user nova-compute[72818]:       <source path='/dev/pts/3'/>
Aug 17 21:18:01 user nova-compute[72818]:       <log file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/console.log' append='off'/>
Aug 17 21:18:01 user nova-compute[72818]:       <target type='isa-serial' port='0'>
Aug 17 21:18:01 user nova-compute[72818]:         <model name='isa-serial'/>
Aug 17 21:18:01 user nova-compute[72818]:       </target>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='serial0'/>
Aug 17 21:18:01 user nova-compute[72818]:     </serial>
Aug 17 21:18:01 user nova-compute[72818]:     <console type='pty' tty='/dev/pts/3'>
Aug 17 21:18:01 user nova-compute[72818]:       <source path='/dev/pts/3'/>
Aug 17 21:18:01 user nova-compute[72818]:       <log file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/console.log' append='off'/>
Aug 17 21:18:01 user nova-compute[72818]:       <target type='serial' port='0'/>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='serial0'/>
Aug 17 21:18:01 user nova-compute[72818]:     </console>
Aug 17 21:18:01 user nova-compute[72818]:     <input type='mouse' bus='ps2'>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='input0'/>
Aug 17 21:18:01 user nova-compute[72818]:     </input>
Aug 17 21:18:01 user nova-compute[72818]:     <input type='keyboard' bus='ps2'>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='input1'/>
Aug 17 21:18:01 user nova-compute[72818]:     </input>
Aug 17 21:18:01 user nova-compute[72818]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Aug 17 21:18:01 user nova-compute[72818]:       <listen type='address' address='0.0.0.0'/>
Aug 17 21:18:01 user nova-compute[72818]:     </graphics>
Aug 17 21:18:01 user nova-compute[72818]:     <audio id='1' type='none'/>
Aug 17 21:18:01 user nova-compute[72818]:     <video>
Aug 17 21:18:01 user nova-compute[72818]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='video0'/>
Aug 17 21:18:01 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 21:18:01 user nova-compute[72818]:     </video>
Aug 17 21:18:01 user nova-compute[72818]:     <memballoon model='virtio'>
Aug 17 21:18:01 user nova-compute[72818]:       <stats period='10'/>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='balloon0'/>
Aug 17 21:18:01 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 21:18:01 user nova-compute[72818]:     </memballoon>
Aug 17 21:18:01 user nova-compute[72818]:     <rng model='virtio'>
Aug 17 21:18:01 user nova-compute[72818]:       <backend model='random'>/dev/urandom</backend>
Aug 17 21:18:01 user nova-compute[72818]:       <alias name='rng0'/>
Aug 17 21:18:01 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 21:18:01 user nova-compute[72818]:     </rng>
Aug 17 21:18:01 user nova-compute[72818]:   </devices>
Aug 17 21:18:01 user nova-compute[72818]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 21:18:01 user nova-compute[72818]:     <label>libvirt-796d2c15-1728-4cd2-a325-e9385556050f</label>
Aug 17 21:18:01 user nova-compute[72818]:     <imagelabel>libvirt-796d2c15-1728-4cd2-a325-e9385556050f</imagelabel>
Aug 17 21:18:01 user nova-compute[72818]:   </seclabel>
Aug 17 21:18:01 user nova-compute[72818]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 21:18:01 user nova-compute[72818]:     <label>+64055:+108</label>
Aug 17 21:18:01 user nova-compute[72818]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 21:18:01 user nova-compute[72818]:   </seclabel>
Aug 17 21:18:01 user nova-compute[72818]: </domain>
Aug 17 21:18:01 user nova-compute[72818]:  {{(pid=72818) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 21:18:01 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Successfully detached device tapd1fd1d06-a2 from instance 796d2c15-1728-4cd2-a325-e9385556050f from the persistent domain config.
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] (1/8): Attempting to detach device tapd1fd1d06-a2 with device alias net1 from instance 796d2c15-1728-4cd2-a325-e9385556050f from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] detach device xml: <interface type="ethernet">
Aug 17 21:18:01 user nova-compute[72818]:   <mac address="fa:16:3e:9e:9b:5a"/>
Aug 17 21:18:01 user nova-compute[72818]:   <model type="virtio"/>
Aug 17 21:18:01 user nova-compute[72818]:   <mtu size="1442"/>
Aug 17 21:18:01 user nova-compute[72818]:   <target dev="tapd1fd1d06-a2"/>
Aug 17 21:18:01 user nova-compute[72818]: </interface>
Aug 17 21:18:01 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:01 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307081.8240147, b4a54471-2c50-435f-8e78-e5cdd1b41093 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:18:01 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] VM Started (Lifecycle Event)
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:01 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:18:01 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:18:02 user nova-compute[72818]: INFO nova.compute.manager [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Took 7.71 seconds to spawn the instance on the hypervisor.
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.objects.instance [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lazy-loading 'flavor' on Instance uuid e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-5330e9cd-fbc1-4f54-915b-d2096e58207e tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.848s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:02 user nova-compute[72818]: INFO nova.compute.manager [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Took 9.52 seconds to build instance.
Aug 17 21:18:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c6137bbe-c43d-4700-9651-eb811d54a697 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.643s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692307082.156177, 796d2c15-1728-4cd2-a325-e9385556050f => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Start waiting for the detach event from libvirt for device tapd1fd1d06-a2 with device alias net1 for instance 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:9b:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1fd1d06-a2"/></interface> {{(pid=72818) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:9b:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1fd1d06-a2"/></interface>not found in domain: <domain type='kvm' id='4'>
Aug 17 21:18:02 user nova-compute[72818]:   <name>instance-00000004</name>
Aug 17 21:18:02 user nova-compute[72818]:   <uuid>796d2c15-1728-4cd2-a325-e9385556050f</uuid>
Aug 17 21:18:02 user nova-compute[72818]:   <metadata>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:18:02 user nova-compute[72818]:   <nova:package version="0.0.0"/>
Aug 17 21:18:02 user nova-compute[72818]:   <nova:name>tempest-device-tagging-server-178282304</nova:name>
Aug 17 21:18:02 user nova-compute[72818]:   <nova:creationTime>2023-08-17 21:17:27</nova:creationTime>
Aug 17 21:18:02 user nova-compute[72818]:   <nova:flavor name="m1.tiny">
Aug 17 21:18:02 user nova-compute[72818]:     <nova:memory>512</nova:memory>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:disk>1</nova:disk>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:swap>0</nova:swap>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:vcpus>1</nova:vcpus>
Aug 17 21:18:02 user nova-compute[72818]:   </nova:flavor>
Aug 17 21:18:02 user nova-compute[72818]:   <nova:owner>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:user uuid="0e7e96b636034002b8994454bc89fdba">tempest-TaggedAttachmentsTest-330612610-project-member</nova:user>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:project uuid="df7d5f3696b24e6a8c96af89e7316ead">tempest-TaggedAttachmentsTest-330612610</nova:project>
Aug 17 21:18:02 user nova-compute[72818]:   </nova:owner>
Aug 17 21:18:02 user nova-compute[72818]:   <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:18:02 user nova-compute[72818]:   <nova:ports>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:port uuid="5e1c71f4-af86-4f7a-8dcf-0210699e469b">
Aug 17 21:18:02 user nova-compute[72818]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 21:18:02 user nova-compute[72818]:     </nova:port>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:port uuid="d1fd1d06-a240-4248-bcbd-4ece6691d8a0">
Aug 17 21:18:02 user nova-compute[72818]:       <nova:ip type="fixed" address="10.10.10.137" ipVersion="4"/>
Aug 17 21:18:02 user nova-compute[72818]:     </nova:port>
Aug 17 21:18:02 user nova-compute[72818]:   </nova:ports>
Aug 17 21:18:02 user nova-compute[72818]: </nova:instance>
Aug 17 21:18:02 user nova-compute[72818]:   </metadata>
Aug 17 21:18:02 user nova-compute[72818]:   <memory unit='KiB'>524288</memory>
Aug 17 21:18:02 user nova-compute[72818]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 21:18:02 user nova-compute[72818]:   <vcpu placement='static'>1</vcpu>
Aug 17 21:18:02 user nova-compute[72818]:   <resource>
Aug 17 21:18:02 user nova-compute[72818]:     <partition>/machine</partition>
Aug 17 21:18:02 user nova-compute[72818]:   </resource>
Aug 17 21:18:02 user nova-compute[72818]:   <sysinfo type='smbios'>
Aug 17 21:18:02 user nova-compute[72818]:     <system>
Aug 17 21:18:02 user nova-compute[72818]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 21:18:02 user nova-compute[72818]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 21:18:02 user nova-compute[72818]:       <entry name='version'>0.0.0</entry>
Aug 17 21:18:02 user nova-compute[72818]:       <entry name='serial'>796d2c15-1728-4cd2-a325-e9385556050f</entry>
Aug 17 21:18:02 user nova-compute[72818]:       <entry name='uuid'>796d2c15-1728-4cd2-a325-e9385556050f</entry>
Aug 17 21:18:02 user nova-compute[72818]:       <entry name='family'>Virtual Machine</entry>
Aug 17 21:18:02 user nova-compute[72818]:     </system>
Aug 17 21:18:02 user nova-compute[72818]:   </sysinfo>
Aug 17 21:18:02 user nova-compute[72818]:   <os>
Aug 17 21:18:02 user nova-compute[72818]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 21:18:02 user nova-compute[72818]:     <boot dev='hd'/>
Aug 17 21:18:02 user nova-compute[72818]:     <smbios mode='sysinfo'/>
Aug 17 21:18:02 user nova-compute[72818]:   </os>
Aug 17 21:18:02 user nova-compute[72818]:   <features>
Aug 17 21:18:02 user nova-compute[72818]:     <acpi/>
Aug 17 21:18:02 user nova-compute[72818]:     <apic/>
Aug 17 21:18:02 user nova-compute[72818]:     <vmcoreinfo state='on'/>
Aug 17 21:18:02 user nova-compute[72818]:   </features>
Aug 17 21:18:02 user nova-compute[72818]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 21:18:02 user nova-compute[72818]:     <model fallback='forbid'>Nehalem</model>
Aug 17 21:18:02 user nova-compute[72818]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 21:18:02 user nova-compute[72818]:     <feature policy='require' name='vme'/>
Aug 17 21:18:02 user nova-compute[72818]:     <feature policy='require' name='x2apic'/>
Aug 17 21:18:02 user nova-compute[72818]:     <feature policy='require' name='hypervisor'/>
Aug 17 21:18:02 user nova-compute[72818]:   </cpu>
Aug 17 21:18:02 user nova-compute[72818]:   <clock offset='utc'>
Aug 17 21:18:02 user nova-compute[72818]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 21:18:02 user nova-compute[72818]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 21:18:02 user nova-compute[72818]:     <timer name='hpet' present='no'/>
Aug 17 21:18:02 user nova-compute[72818]:   </clock>
Aug 17 21:18:02 user nova-compute[72818]:   <on_poweroff>destroy</on_poweroff>
Aug 17 21:18:02 user nova-compute[72818]:   <on_reboot>restart</on_reboot>
Aug 17 21:18:02 user nova-compute[72818]:   <on_crash>destroy</on_crash>
Aug 17 21:18:02 user nova-compute[72818]:   <devices>
Aug 17 21:18:02 user nova-compute[72818]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 21:18:02 user nova-compute[72818]:     <disk type='file' device='disk'>
Aug 17 21:18:02 user nova-compute[72818]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 21:18:02 user nova-compute[72818]:       <source file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk' index='2'/>
Aug 17 21:18:02 user nova-compute[72818]:       <backingStore type='file' index='3'>
Aug 17 21:18:02 user nova-compute[72818]:         <format type='raw'/>
Aug 17 21:18:02 user nova-compute[72818]:         <source file='/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35'/>
Aug 17 21:18:02 user nova-compute[72818]:         <backingStore/>
Aug 17 21:18:02 user nova-compute[72818]:       </backingStore>
Aug 17 21:18:02 user nova-compute[72818]:       <target dev='vda' bus='virtio'/>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='virtio-disk0'/>
Aug 17 21:18:02 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 21:18:02 user nova-compute[72818]:     </disk>
Aug 17 21:18:02 user nova-compute[72818]:     <disk type='file' device='cdrom'>
Aug 17 21:18:02 user nova-compute[72818]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 21:18:02 user nova-compute[72818]:       <source file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk.config' index='1'/>
Aug 17 21:18:02 user nova-compute[72818]:       <backingStore/>
Aug 17 21:18:02 user nova-compute[72818]:       <target dev='hda' bus='ide'/>
Aug 17 21:18:02 user nova-compute[72818]:       <readonly/>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='ide0-0-0'/>
Aug 17 21:18:02 user nova-compute[72818]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 21:18:02 user nova-compute[72818]:     </disk>
Aug 17 21:18:02 user nova-compute[72818]:     <controller type='usb' index='0' model='none'>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='usb'/>
Aug 17 21:18:02 user nova-compute[72818]:     </controller>
Aug 17 21:18:02 user nova-compute[72818]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='pci.0'/>
Aug 17 21:18:02 user nova-compute[72818]:     </controller>
Aug 17 21:18:02 user nova-compute[72818]:     <controller type='ide' index='0'>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='ide'/>
Aug 17 21:18:02 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 21:18:02 user nova-compute[72818]:     </controller>
Aug 17 21:18:02 user nova-compute[72818]:     <interface type='ethernet'>
Aug 17 21:18:02 user nova-compute[72818]:       <mac address='fa:16:3e:1c:94:f9'/>
Aug 17 21:18:02 user nova-compute[72818]:       <target dev='tap5e1c71f4-af'/>
Aug 17 21:18:02 user nova-compute[72818]:       <model type='virtio'/>
Aug 17 21:18:02 user nova-compute[72818]:       <mtu size='1442'/>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='net0'/>
Aug 17 21:18:02 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 21:18:02 user nova-compute[72818]:     </interface>
Aug 17 21:18:02 user nova-compute[72818]:     <serial type='pty'>
Aug 17 21:18:02 user nova-compute[72818]:       <source path='/dev/pts/3'/>
Aug 17 21:18:02 user nova-compute[72818]:       <log file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/console.log' append='off'/>
Aug 17 21:18:02 user nova-compute[72818]:       <target type='isa-serial' port='0'>
Aug 17 21:18:02 user nova-compute[72818]:         <model name='isa-serial'/>
Aug 17 21:18:02 user nova-compute[72818]:       </target>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='serial0'/>
Aug 17 21:18:02 user nova-compute[72818]:     </serial>
Aug 17 21:18:02 user nova-compute[72818]:     <console type='pty' tty='/dev/pts/3'>
Aug 17 21:18:02 user nova-compute[72818]:       <source path='/dev/pts/3'/>
Aug 17 21:18:02 user nova-compute[72818]:       <log file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/console.log' append='off'/>
Aug 17 21:18:02 user nova-compute[72818]:       <target type='serial' port='0'/>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='serial0'/>
Aug 17 21:18:02 user nova-compute[72818]:     </console>
Aug 17 21:18:02 user nova-compute[72818]:     <input type='mouse' bus='ps2'>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='input0'/>
Aug 17 21:18:02 user nova-compute[72818]:     </input>
Aug 17 21:18:02 user nova-compute[72818]:     <input type='keyboard' bus='ps2'>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='input1'/>
Aug 17 21:18:02 user nova-compute[72818]:     </input>
Aug 17 21:18:02 user nova-compute[72818]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Aug 17 21:18:02 user nova-compute[72818]:       <listen type='address' address='0.0.0.0'/>
Aug 17 21:18:02 user nova-compute[72818]:     </graphics>
Aug 17 21:18:02 user nova-compute[72818]:     <audio id='1' type='none'/>
Aug 17 21:18:02 user nova-compute[72818]:     <video>
Aug 17 21:18:02 user nova-compute[72818]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='video0'/>
Aug 17 21:18:02 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 21:18:02 user nova-compute[72818]:     </video>
Aug 17 21:18:02 user nova-compute[72818]:     <memballoon model='virtio'>
Aug 17 21:18:02 user nova-compute[72818]:       <stats period='10'/>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='balloon0'/>
Aug 17 21:18:02 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 21:18:02 user nova-compute[72818]:     </memballoon>
Aug 17 21:18:02 user nova-compute[72818]:     <rng model='virtio'>
Aug 17 21:18:02 user nova-compute[72818]:       <backend model='random'>/dev/urandom</backend>
Aug 17 21:18:02 user nova-compute[72818]:       <alias name='rng0'/>
Aug 17 21:18:02 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 21:18:02 user nova-compute[72818]:     </rng>
Aug 17 21:18:02 user nova-compute[72818]:   </devices>
Aug 17 21:18:02 user nova-compute[72818]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 21:18:02 user nova-compute[72818]:     <label>libvirt-796d2c15-1728-4cd2-a325-e9385556050f</label>
Aug 17 21:18:02 user nova-compute[72818]:     <imagelabel>libvirt-796d2c15-1728-4cd2-a325-e9385556050f</imagelabel>
Aug 17 21:18:02 user nova-compute[72818]:   </seclabel>
Aug 17 21:18:02 user nova-compute[72818]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 21:18:02 user nova-compute[72818]:     <label>+64055:+108</label>
Aug 17 21:18:02 user nova-compute[72818]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 21:18:02 user nova-compute[72818]:   </seclabel>
Aug 17 21:18:02 user nova-compute[72818]: </domain>
Aug 17 21:18:02 user nova-compute[72818]:  {{(pid=72818) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 21:18:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Successfully detached device tapd1fd1d06-a2 from instance 796d2c15-1728-4cd2-a325-e9385556050f from the live domain config.
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178282304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178282304',id=4,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkwVGCdlBlVcOiwisZJ2m7rAADqLOL+kywXDgvAwR2qTgTTFDHWjasH/U7eolNcNHdZLXQQor9tYHlFwFKvEPgekkTkSGi0+Q6MQwEnZ2+/phVBP+RILBn2kgk74jej4g==',key_name='tempest-keypair-1982021055',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df7d5f3696b24e6a8c96af89e7316ead',ramdisk_id='',reservation_id='r-3sr5sqxw',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-330612610',owner_user_name='tempest-TaggedAttachmentsTest-330612610-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e7e96b636034002b8994454bc89fdba',uuid=796d2c15-1728-4cd2-a325-e9385556050f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converting VIF {"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9b:5a,bridge_name='br-int',has_traffic_filtering=True,id=d1fd1d06-a240-4248-bcbd-4ece6691d8a0,network=Network(0770b32d-1b12-42fc-84a1-77339ca53fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1fd1d06-a2') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG os_vif [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9b:5a,bridge_name='br-int',has_traffic_filtering=True,id=d1fd1d06-a240-4248-bcbd-4ece6691d8a0,network=Network(0770b32d-1b12-42fc-84a1-77339ca53fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1fd1d06-a2') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1fd1d06-a2, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:02 user nova-compute[72818]: INFO os_vif [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9b:5a,bridge_name='br-int',has_traffic_filtering=True,id=d1fd1d06-a240-4248-bcbd-4ece6691d8a0,network=Network(0770b32d-1b12-42fc-84a1-77339ca53fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1fd1d06-a2')
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:18:02 user nova-compute[72818]:   <nova:package version="0.0.0"/>
Aug 17 21:18:02 user nova-compute[72818]:   <nova:name>tempest-device-tagging-server-178282304</nova:name>
Aug 17 21:18:02 user nova-compute[72818]:   <nova:creationTime>2023-08-17 21:18:02</nova:creationTime>
Aug 17 21:18:02 user nova-compute[72818]:   <nova:flavor name="m1.tiny">
Aug 17 21:18:02 user nova-compute[72818]:     <nova:memory>512</nova:memory>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:disk>1</nova:disk>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:swap>0</nova:swap>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:vcpus>1</nova:vcpus>
Aug 17 21:18:02 user nova-compute[72818]:   </nova:flavor>
Aug 17 21:18:02 user nova-compute[72818]:   <nova:owner>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:user uuid="0e7e96b636034002b8994454bc89fdba">tempest-TaggedAttachmentsTest-330612610-project-member</nova:user>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:project uuid="df7d5f3696b24e6a8c96af89e7316ead">tempest-TaggedAttachmentsTest-330612610</nova:project>
Aug 17 21:18:02 user nova-compute[72818]:   </nova:owner>
Aug 17 21:18:02 user nova-compute[72818]:   <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:18:02 user nova-compute[72818]:   <nova:ports>
Aug 17 21:18:02 user nova-compute[72818]:     <nova:port uuid="5e1c71f4-af86-4f7a-8dcf-0210699e469b">
Aug 17 21:18:02 user nova-compute[72818]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 21:18:02 user nova-compute[72818]:     </nova:port>
Aug 17 21:18:02 user nova-compute[72818]:   </nova:ports>
Aug 17 21:18:02 user nova-compute[72818]: </nova:instance>
Aug 17 21:18:02 user nova-compute[72818]:  {{(pid=72818) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-24e22ee6-4f1a-4b5c-9187-11e1428b27f0 req-c7aa8e59-90dc-41cf-a8e9-146dea77a466 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-vif-unplugged-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-24e22ee6-4f1a-4b5c-9187-11e1428b27f0 req-c7aa8e59-90dc-41cf-a8e9-146dea77a466 service nova] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-24e22ee6-4f1a-4b5c-9187-11e1428b27f0 req-c7aa8e59-90dc-41cf-a8e9-146dea77a466 service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-24e22ee6-4f1a-4b5c-9187-11e1428b27f0 req-c7aa8e59-90dc-41cf-a8e9-146dea77a466 service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-24e22ee6-4f1a-4b5c-9187-11e1428b27f0 req-c7aa8e59-90dc-41cf-a8e9-146dea77a466 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] No waiting events found dispatching network-vif-unplugged-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:02 user nova-compute[72818]: WARNING nova.compute.manager [req-24e22ee6-4f1a-4b5c-9187-11e1428b27f0 req-c7aa8e59-90dc-41cf-a8e9-146dea77a466 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received unexpected event network-vif-unplugged-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 for instance with vm_state active and task_state None.
Aug 17 21:18:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:02 user nova-compute[72818]: INFO nova.compute.manager [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Terminating instance
Aug 17 21:18:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-vif-deleted-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:03 user nova-compute[72818]: INFO nova.compute.manager [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Neutron deleted interface d1fd1d06-a240-4248-bcbd-4ece6691d8a0; detaching it from the instance and deleting it from the info cache
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.network.neutron [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updating instance_info_cache with network_info: [{"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.objects.instance [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] Lazy-loading 'system_metadata' on Instance uuid 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquired lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.objects.instance [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] Lazy-loading 'flavor' on Instance uuid 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178282304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178282304',id=4,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkwVGCdlBlVcOiwisZJ2m7rAADqLOL+kywXDgvAwR2qTgTTFDHWjasH/U7eolNcNHdZLXQQor9tYHlFwFKvEPgekkTkSGi0+Q6MQwEnZ2+/phVBP+RILBn2kgk74jej4g==',key_name='tempest-keypair-1982021055',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df7d5f3696b24e6a8c96af89e7316ead',ramdisk_id='',reservation_id='r-3sr5sqxw',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-330612610',owner_user_name='tempest-TaggedAttachmentsTest-330612610-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e7e96b636034002b8994454bc89fdba',uuid=796d2c15-1728-4cd2-a325-e9385556050f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.network.os_vif_util [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] Converting VIF {"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.network.os_vif_util [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9b:5a,bridge_name='br-int',has_traffic_filtering=True,id=d1fd1d06-a240-4248-bcbd-4ece6691d8a0,network=Network(0770b32d-1b12-42fc-84a1-77339ca53fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1fd1d06-a2') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:9b:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1fd1d06-a2"/></interface> {{(pid=72818) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:9b:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1fd1d06-a2"/></interface>not found in domain: <domain type='kvm' id='4'>
Aug 17 21:18:03 user nova-compute[72818]:   <name>instance-00000004</name>
Aug 17 21:18:03 user nova-compute[72818]:   <uuid>796d2c15-1728-4cd2-a325-e9385556050f</uuid>
Aug 17 21:18:03 user nova-compute[72818]:   <metadata>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:18:03 user nova-compute[72818]:   <nova:package version="0.0.0"/>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:name>tempest-device-tagging-server-178282304</nova:name>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:creationTime>2023-08-17 21:18:02</nova:creationTime>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:flavor name="m1.tiny">
Aug 17 21:18:03 user nova-compute[72818]:     <nova:memory>512</nova:memory>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:disk>1</nova:disk>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:swap>0</nova:swap>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:vcpus>1</nova:vcpus>
Aug 17 21:18:03 user nova-compute[72818]:   </nova:flavor>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:owner>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:user uuid="0e7e96b636034002b8994454bc89fdba">tempest-TaggedAttachmentsTest-330612610-project-member</nova:user>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:project uuid="df7d5f3696b24e6a8c96af89e7316ead">tempest-TaggedAttachmentsTest-330612610</nova:project>
Aug 17 21:18:03 user nova-compute[72818]:   </nova:owner>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:ports>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:port uuid="5e1c71f4-af86-4f7a-8dcf-0210699e469b">
Aug 17 21:18:03 user nova-compute[72818]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 21:18:03 user nova-compute[72818]:     </nova:port>
Aug 17 21:18:03 user nova-compute[72818]:   </nova:ports>
Aug 17 21:18:03 user nova-compute[72818]: </nova:instance>
Aug 17 21:18:03 user nova-compute[72818]:   </metadata>
Aug 17 21:18:03 user nova-compute[72818]:   <memory unit='KiB'>524288</memory>
Aug 17 21:18:03 user nova-compute[72818]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 21:18:03 user nova-compute[72818]:   <vcpu placement='static'>1</vcpu>
Aug 17 21:18:03 user nova-compute[72818]:   <resource>
Aug 17 21:18:03 user nova-compute[72818]:     <partition>/machine</partition>
Aug 17 21:18:03 user nova-compute[72818]:   </resource>
Aug 17 21:18:03 user nova-compute[72818]:   <sysinfo type='smbios'>
Aug 17 21:18:03 user nova-compute[72818]:     <system>
Aug 17 21:18:03 user nova-compute[72818]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 21:18:03 user nova-compute[72818]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 21:18:03 user nova-compute[72818]:       <entry name='version'>0.0.0</entry>
Aug 17 21:18:03 user nova-compute[72818]:       <entry name='serial'>796d2c15-1728-4cd2-a325-e9385556050f</entry>
Aug 17 21:18:03 user nova-compute[72818]:       <entry name='uuid'>796d2c15-1728-4cd2-a325-e9385556050f</entry>
Aug 17 21:18:03 user nova-compute[72818]:       <entry name='family'>Virtual Machine</entry>
Aug 17 21:18:03 user nova-compute[72818]:     </system>
Aug 17 21:18:03 user nova-compute[72818]:   </sysinfo>
Aug 17 21:18:03 user nova-compute[72818]:   <os>
Aug 17 21:18:03 user nova-compute[72818]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 21:18:03 user nova-compute[72818]:     <boot dev='hd'/>
Aug 17 21:18:03 user nova-compute[72818]:     <smbios mode='sysinfo'/>
Aug 17 21:18:03 user nova-compute[72818]:   </os>
Aug 17 21:18:03 user nova-compute[72818]:   <features>
Aug 17 21:18:03 user nova-compute[72818]:     <acpi/>
Aug 17 21:18:03 user nova-compute[72818]:     <apic/>
Aug 17 21:18:03 user nova-compute[72818]:     <vmcoreinfo state='on'/>
Aug 17 21:18:03 user nova-compute[72818]:   </features>
Aug 17 21:18:03 user nova-compute[72818]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 21:18:03 user nova-compute[72818]:     <model fallback='forbid'>Nehalem</model>
Aug 17 21:18:03 user nova-compute[72818]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 21:18:03 user nova-compute[72818]:     <feature policy='require' name='vme'/>
Aug 17 21:18:03 user nova-compute[72818]:     <feature policy='require' name='x2apic'/>
Aug 17 21:18:03 user nova-compute[72818]:     <feature policy='require' name='hypervisor'/>
Aug 17 21:18:03 user nova-compute[72818]:   </cpu>
Aug 17 21:18:03 user nova-compute[72818]:   <clock offset='utc'>
Aug 17 21:18:03 user nova-compute[72818]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 21:18:03 user nova-compute[72818]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 21:18:03 user nova-compute[72818]:     <timer name='hpet' present='no'/>
Aug 17 21:18:03 user nova-compute[72818]:   </clock>
Aug 17 21:18:03 user nova-compute[72818]:   <on_poweroff>destroy</on_poweroff>
Aug 17 21:18:03 user nova-compute[72818]:   <on_reboot>restart</on_reboot>
Aug 17 21:18:03 user nova-compute[72818]:   <on_crash>destroy</on_crash>
Aug 17 21:18:03 user nova-compute[72818]:   <devices>
Aug 17 21:18:03 user nova-compute[72818]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 21:18:03 user nova-compute[72818]:     <disk type='file' device='disk'>
Aug 17 21:18:03 user nova-compute[72818]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 21:18:03 user nova-compute[72818]:       <source file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk' index='2'/>
Aug 17 21:18:03 user nova-compute[72818]:       <backingStore type='file' index='3'>
Aug 17 21:18:03 user nova-compute[72818]:         <format type='raw'/>
Aug 17 21:18:03 user nova-compute[72818]:         <source file='/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35'/>
Aug 17 21:18:03 user nova-compute[72818]:         <backingStore/>
Aug 17 21:18:03 user nova-compute[72818]:       </backingStore>
Aug 17 21:18:03 user nova-compute[72818]:       <target dev='vda' bus='virtio'/>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='virtio-disk0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </disk>
Aug 17 21:18:03 user nova-compute[72818]:     <disk type='file' device='cdrom'>
Aug 17 21:18:03 user nova-compute[72818]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 21:18:03 user nova-compute[72818]:       <source file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk.config' index='1'/>
Aug 17 21:18:03 user nova-compute[72818]:       <backingStore/>
Aug 17 21:18:03 user nova-compute[72818]:       <target dev='hda' bus='ide'/>
Aug 17 21:18:03 user nova-compute[72818]:       <readonly/>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='ide0-0-0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </disk>
Aug 17 21:18:03 user nova-compute[72818]:     <controller type='usb' index='0' model='none'>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='usb'/>
Aug 17 21:18:03 user nova-compute[72818]:     </controller>
Aug 17 21:18:03 user nova-compute[72818]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='pci.0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </controller>
Aug 17 21:18:03 user nova-compute[72818]:     <controller type='ide' index='0'>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='ide'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 21:18:03 user nova-compute[72818]:     </controller>
Aug 17 21:18:03 user nova-compute[72818]:     <interface type='ethernet'>
Aug 17 21:18:03 user nova-compute[72818]:       <mac address='fa:16:3e:1c:94:f9'/>
Aug 17 21:18:03 user nova-compute[72818]:       <target dev='tap5e1c71f4-af'/>
Aug 17 21:18:03 user nova-compute[72818]:       <model type='virtio'/>
Aug 17 21:18:03 user nova-compute[72818]:       <mtu size='1442'/>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='net0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </interface>
Aug 17 21:18:03 user nova-compute[72818]:     <serial type='pty'>
Aug 17 21:18:03 user nova-compute[72818]:       <source path='/dev/pts/3'/>
Aug 17 21:18:03 user nova-compute[72818]:       <log file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/console.log' append='off'/>
Aug 17 21:18:03 user nova-compute[72818]:       <target type='isa-serial' port='0'>
Aug 17 21:18:03 user nova-compute[72818]:         <model name='isa-serial'/>
Aug 17 21:18:03 user nova-compute[72818]:       </target>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='serial0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </serial>
Aug 17 21:18:03 user nova-compute[72818]:     <console type='pty' tty='/dev/pts/3'>
Aug 17 21:18:03 user nova-compute[72818]:       <source path='/dev/pts/3'/>
Aug 17 21:18:03 user nova-compute[72818]:       <log file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/console.log' append='off'/>
Aug 17 21:18:03 user nova-compute[72818]:       <target type='serial' port='0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='serial0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </console>
Aug 17 21:18:03 user nova-compute[72818]:     <input type='mouse' bus='ps2'>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='input0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </input>
Aug 17 21:18:03 user nova-compute[72818]:     <input type='keyboard' bus='ps2'>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='input1'/>
Aug 17 21:18:03 user nova-compute[72818]:     </input>
Aug 17 21:18:03 user nova-compute[72818]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Aug 17 21:18:03 user nova-compute[72818]:       <listen type='address' address='0.0.0.0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </graphics>
Aug 17 21:18:03 user nova-compute[72818]:     <audio id='1' type='none'/>
Aug 17 21:18:03 user nova-compute[72818]:     <video>
Aug 17 21:18:03 user nova-compute[72818]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='video0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </video>
Aug 17 21:18:03 user nova-compute[72818]:     <memballoon model='virtio'>
Aug 17 21:18:03 user nova-compute[72818]:       <stats period='10'/>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='balloon0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </memballoon>
Aug 17 21:18:03 user nova-compute[72818]:     <rng model='virtio'>
Aug 17 21:18:03 user nova-compute[72818]:       <backend model='random'>/dev/urandom</backend>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='rng0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </rng>
Aug 17 21:18:03 user nova-compute[72818]:   </devices>
Aug 17 21:18:03 user nova-compute[72818]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 21:18:03 user nova-compute[72818]:     <label>libvirt-796d2c15-1728-4cd2-a325-e9385556050f</label>
Aug 17 21:18:03 user nova-compute[72818]:     <imagelabel>libvirt-796d2c15-1728-4cd2-a325-e9385556050f</imagelabel>
Aug 17 21:18:03 user nova-compute[72818]:   </seclabel>
Aug 17 21:18:03 user nova-compute[72818]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 21:18:03 user nova-compute[72818]:     <label>+64055:+108</label>
Aug 17 21:18:03 user nova-compute[72818]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 21:18:03 user nova-compute[72818]:   </seclabel>
Aug 17 21:18:03 user nova-compute[72818]: </domain>
Aug 17 21:18:03 user nova-compute[72818]:  {{(pid=72818) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:9b:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1fd1d06-a2"/></interface> {{(pid=72818) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:9b:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1fd1d06-a2"/></interface>not found in domain: <domain type='kvm' id='4'>
Aug 17 21:18:03 user nova-compute[72818]:   <name>instance-00000004</name>
Aug 17 21:18:03 user nova-compute[72818]:   <uuid>796d2c15-1728-4cd2-a325-e9385556050f</uuid>
Aug 17 21:18:03 user nova-compute[72818]:   <metadata>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:18:03 user nova-compute[72818]:   <nova:package version="0.0.0"/>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:name>tempest-device-tagging-server-178282304</nova:name>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:creationTime>2023-08-17 21:18:02</nova:creationTime>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:flavor name="m1.tiny">
Aug 17 21:18:03 user nova-compute[72818]:     <nova:memory>512</nova:memory>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:disk>1</nova:disk>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:swap>0</nova:swap>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:vcpus>1</nova:vcpus>
Aug 17 21:18:03 user nova-compute[72818]:   </nova:flavor>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:owner>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:user uuid="0e7e96b636034002b8994454bc89fdba">tempest-TaggedAttachmentsTest-330612610-project-member</nova:user>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:project uuid="df7d5f3696b24e6a8c96af89e7316ead">tempest-TaggedAttachmentsTest-330612610</nova:project>
Aug 17 21:18:03 user nova-compute[72818]:   </nova:owner>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:ports>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:port uuid="5e1c71f4-af86-4f7a-8dcf-0210699e469b">
Aug 17 21:18:03 user nova-compute[72818]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 21:18:03 user nova-compute[72818]:     </nova:port>
Aug 17 21:18:03 user nova-compute[72818]:   </nova:ports>
Aug 17 21:18:03 user nova-compute[72818]: </nova:instance>
Aug 17 21:18:03 user nova-compute[72818]:   </metadata>
Aug 17 21:18:03 user nova-compute[72818]:   <memory unit='KiB'>524288</memory>
Aug 17 21:18:03 user nova-compute[72818]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 21:18:03 user nova-compute[72818]:   <vcpu placement='static'>1</vcpu>
Aug 17 21:18:03 user nova-compute[72818]:   <resource>
Aug 17 21:18:03 user nova-compute[72818]:     <partition>/machine</partition>
Aug 17 21:18:03 user nova-compute[72818]:   </resource>
Aug 17 21:18:03 user nova-compute[72818]:   <sysinfo type='smbios'>
Aug 17 21:18:03 user nova-compute[72818]:     <system>
Aug 17 21:18:03 user nova-compute[72818]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 21:18:03 user nova-compute[72818]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 21:18:03 user nova-compute[72818]:       <entry name='version'>0.0.0</entry>
Aug 17 21:18:03 user nova-compute[72818]:       <entry name='serial'>796d2c15-1728-4cd2-a325-e9385556050f</entry>
Aug 17 21:18:03 user nova-compute[72818]:       <entry name='uuid'>796d2c15-1728-4cd2-a325-e9385556050f</entry>
Aug 17 21:18:03 user nova-compute[72818]:       <entry name='family'>Virtual Machine</entry>
Aug 17 21:18:03 user nova-compute[72818]:     </system>
Aug 17 21:18:03 user nova-compute[72818]:   </sysinfo>
Aug 17 21:18:03 user nova-compute[72818]:   <os>
Aug 17 21:18:03 user nova-compute[72818]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 21:18:03 user nova-compute[72818]:     <boot dev='hd'/>
Aug 17 21:18:03 user nova-compute[72818]:     <smbios mode='sysinfo'/>
Aug 17 21:18:03 user nova-compute[72818]:   </os>
Aug 17 21:18:03 user nova-compute[72818]:   <features>
Aug 17 21:18:03 user nova-compute[72818]:     <acpi/>
Aug 17 21:18:03 user nova-compute[72818]:     <apic/>
Aug 17 21:18:03 user nova-compute[72818]:     <vmcoreinfo state='on'/>
Aug 17 21:18:03 user nova-compute[72818]:   </features>
Aug 17 21:18:03 user nova-compute[72818]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 21:18:03 user nova-compute[72818]:     <model fallback='forbid'>Nehalem</model>
Aug 17 21:18:03 user nova-compute[72818]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 21:18:03 user nova-compute[72818]:     <feature policy='require' name='vme'/>
Aug 17 21:18:03 user nova-compute[72818]:     <feature policy='require' name='x2apic'/>
Aug 17 21:18:03 user nova-compute[72818]:     <feature policy='require' name='hypervisor'/>
Aug 17 21:18:03 user nova-compute[72818]:   </cpu>
Aug 17 21:18:03 user nova-compute[72818]:   <clock offset='utc'>
Aug 17 21:18:03 user nova-compute[72818]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 21:18:03 user nova-compute[72818]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 21:18:03 user nova-compute[72818]:     <timer name='hpet' present='no'/>
Aug 17 21:18:03 user nova-compute[72818]:   </clock>
Aug 17 21:18:03 user nova-compute[72818]:   <on_poweroff>destroy</on_poweroff>
Aug 17 21:18:03 user nova-compute[72818]:   <on_reboot>restart</on_reboot>
Aug 17 21:18:03 user nova-compute[72818]:   <on_crash>destroy</on_crash>
Aug 17 21:18:03 user nova-compute[72818]:   <devices>
Aug 17 21:18:03 user nova-compute[72818]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 21:18:03 user nova-compute[72818]:     <disk type='file' device='disk'>
Aug 17 21:18:03 user nova-compute[72818]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 21:18:03 user nova-compute[72818]:       <source file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk' index='2'/>
Aug 17 21:18:03 user nova-compute[72818]:       <backingStore type='file' index='3'>
Aug 17 21:18:03 user nova-compute[72818]:         <format type='raw'/>
Aug 17 21:18:03 user nova-compute[72818]:         <source file='/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35'/>
Aug 17 21:18:03 user nova-compute[72818]:         <backingStore/>
Aug 17 21:18:03 user nova-compute[72818]:       </backingStore>
Aug 17 21:18:03 user nova-compute[72818]:       <target dev='vda' bus='virtio'/>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='virtio-disk0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </disk>
Aug 17 21:18:03 user nova-compute[72818]:     <disk type='file' device='cdrom'>
Aug 17 21:18:03 user nova-compute[72818]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 21:18:03 user nova-compute[72818]:       <source file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk.config' index='1'/>
Aug 17 21:18:03 user nova-compute[72818]:       <backingStore/>
Aug 17 21:18:03 user nova-compute[72818]:       <target dev='hda' bus='ide'/>
Aug 17 21:18:03 user nova-compute[72818]:       <readonly/>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='ide0-0-0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </disk>
Aug 17 21:18:03 user nova-compute[72818]:     <controller type='usb' index='0' model='none'>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='usb'/>
Aug 17 21:18:03 user nova-compute[72818]:     </controller>
Aug 17 21:18:03 user nova-compute[72818]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='pci.0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </controller>
Aug 17 21:18:03 user nova-compute[72818]:     <controller type='ide' index='0'>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='ide'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 21:18:03 user nova-compute[72818]:     </controller>
Aug 17 21:18:03 user nova-compute[72818]:     <interface type='ethernet'>
Aug 17 21:18:03 user nova-compute[72818]:       <mac address='fa:16:3e:1c:94:f9'/>
Aug 17 21:18:03 user nova-compute[72818]:       <target dev='tap5e1c71f4-af'/>
Aug 17 21:18:03 user nova-compute[72818]:       <model type='virtio'/>
Aug 17 21:18:03 user nova-compute[72818]:       <mtu size='1442'/>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='net0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </interface>
Aug 17 21:18:03 user nova-compute[72818]:     <serial type='pty'>
Aug 17 21:18:03 user nova-compute[72818]:       <source path='/dev/pts/3'/>
Aug 17 21:18:03 user nova-compute[72818]:       <log file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/console.log' append='off'/>
Aug 17 21:18:03 user nova-compute[72818]:       <target type='isa-serial' port='0'>
Aug 17 21:18:03 user nova-compute[72818]:         <model name='isa-serial'/>
Aug 17 21:18:03 user nova-compute[72818]:       </target>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='serial0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </serial>
Aug 17 21:18:03 user nova-compute[72818]:     <console type='pty' tty='/dev/pts/3'>
Aug 17 21:18:03 user nova-compute[72818]:       <source path='/dev/pts/3'/>
Aug 17 21:18:03 user nova-compute[72818]:       <log file='/opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/console.log' append='off'/>
Aug 17 21:18:03 user nova-compute[72818]:       <target type='serial' port='0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='serial0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </console>
Aug 17 21:18:03 user nova-compute[72818]:     <input type='mouse' bus='ps2'>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='input0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </input>
Aug 17 21:18:03 user nova-compute[72818]:     <input type='keyboard' bus='ps2'>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='input1'/>
Aug 17 21:18:03 user nova-compute[72818]:     </input>
Aug 17 21:18:03 user nova-compute[72818]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Aug 17 21:18:03 user nova-compute[72818]:       <listen type='address' address='0.0.0.0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </graphics>
Aug 17 21:18:03 user nova-compute[72818]:     <audio id='1' type='none'/>
Aug 17 21:18:03 user nova-compute[72818]:     <video>
Aug 17 21:18:03 user nova-compute[72818]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='video0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </video>
Aug 17 21:18:03 user nova-compute[72818]:     <memballoon model='virtio'>
Aug 17 21:18:03 user nova-compute[72818]:       <stats period='10'/>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='balloon0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </memballoon>
Aug 17 21:18:03 user nova-compute[72818]:     <rng model='virtio'>
Aug 17 21:18:03 user nova-compute[72818]:       <backend model='random'>/dev/urandom</backend>
Aug 17 21:18:03 user nova-compute[72818]:       <alias name='rng0'/>
Aug 17 21:18:03 user nova-compute[72818]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 21:18:03 user nova-compute[72818]:     </rng>
Aug 17 21:18:03 user nova-compute[72818]:   </devices>
Aug 17 21:18:03 user nova-compute[72818]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 21:18:03 user nova-compute[72818]:     <label>libvirt-796d2c15-1728-4cd2-a325-e9385556050f</label>
Aug 17 21:18:03 user nova-compute[72818]:     <imagelabel>libvirt-796d2c15-1728-4cd2-a325-e9385556050f</imagelabel>
Aug 17 21:18:03 user nova-compute[72818]:   </seclabel>
Aug 17 21:18:03 user nova-compute[72818]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 21:18:03 user nova-compute[72818]:     <label>+64055:+108</label>
Aug 17 21:18:03 user nova-compute[72818]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 21:18:03 user nova-compute[72818]:   </seclabel>
Aug 17 21:18:03 user nova-compute[72818]: </domain>
Aug 17 21:18:03 user nova-compute[72818]:  {{(pid=72818) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 21:18:03 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Detaching interface fa:16:3e:9e:9b:5a failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapd1fd1d06-a2' not found.
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178282304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178282304',id=4,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkwVGCdlBlVcOiwisZJ2m7rAADqLOL+kywXDgvAwR2qTgTTFDHWjasH/U7eolNcNHdZLXQQor9tYHlFwFKvEPgekkTkSGi0+Q6MQwEnZ2+/phVBP+RILBn2kgk74jej4g==',key_name='tempest-keypair-1982021055',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df7d5f3696b24e6a8c96af89e7316ead',ramdisk_id='',reservation_id='r-3sr5sqxw',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-330612610',owner_user_name='tempest-TaggedAttachmentsTest-330612610-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e7e96b636034002b8994454bc89fdba',uuid=796d2c15-1728-4cd2-a325-e9385556050f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.network.os_vif_util [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] Converting VIF {"id": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "address": "fa:16:3e:9e:9b:5a", "network": {"id": "0770b32d-1b12-42fc-84a1-77339ca53fb4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1643852534", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1fd1d06-a2", "ovs_interfaceid": "d1fd1d06-a240-4248-bcbd-4ece6691d8a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.network.os_vif_util [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9b:5a,bridge_name='br-int',has_traffic_filtering=True,id=d1fd1d06-a240-4248-bcbd-4ece6691d8a0,network=Network(0770b32d-1b12-42fc-84a1-77339ca53fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1fd1d06-a2') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG os_vif [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9b:5a,bridge_name='br-int',has_traffic_filtering=True,id=d1fd1d06-a240-4248-bcbd-4ece6691d8a0,network=Network(0770b32d-1b12-42fc-84a1-77339ca53fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1fd1d06-a2') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1fd1d06-a2, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:18:03 user nova-compute[72818]: INFO os_vif [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9b:5a,bridge_name='br-int',has_traffic_filtering=True,id=d1fd1d06-a240-4248-bcbd-4ece6691d8a0,network=Network(0770b32d-1b12-42fc-84a1-77339ca53fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1fd1d06-a2')
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [req-1323ad6b-f66d-48a8-b52a-8a1002f433b1 req-b280019e-9d40-4768-a698-6cbaab30e8b5 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:18:03 user nova-compute[72818]:   <nova:package version="0.0.0"/>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:name>tempest-device-tagging-server-178282304</nova:name>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:creationTime>2023-08-17 21:18:03</nova:creationTime>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:flavor name="m1.tiny">
Aug 17 21:18:03 user nova-compute[72818]:     <nova:memory>512</nova:memory>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:disk>1</nova:disk>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:swap>0</nova:swap>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:vcpus>1</nova:vcpus>
Aug 17 21:18:03 user nova-compute[72818]:   </nova:flavor>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:owner>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:user uuid="0e7e96b636034002b8994454bc89fdba">tempest-TaggedAttachmentsTest-330612610-project-member</nova:user>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:project uuid="df7d5f3696b24e6a8c96af89e7316ead">tempest-TaggedAttachmentsTest-330612610</nova:project>
Aug 17 21:18:03 user nova-compute[72818]:   </nova:owner>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:18:03 user nova-compute[72818]:   <nova:ports>
Aug 17 21:18:03 user nova-compute[72818]:     <nova:port uuid="5e1c71f4-af86-4f7a-8dcf-0210699e469b">
Aug 17 21:18:03 user nova-compute[72818]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 21:18:03 user nova-compute[72818]:     </nova:port>
Aug 17 21:18:03 user nova-compute[72818]:   </nova:ports>
Aug 17 21:18:03 user nova-compute[72818]: </nova:instance>
Aug 17 21:18:03 user nova-compute[72818]:  {{(pid=72818) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Instance destroyed successfully.
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lazy-loading 'resources' on Instance uuid e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1975556709',display_name='tempest-AttachSCSIVolumeTestJSON-server-1975556709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1975556709',id=6,image_ref='68302231-6837-4de4-88cf-f348cba7cb65',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfKFkJs56F3KDUJ9KoKnhLo304OcT+d2HiKFnhQhbROkzoI2FYMtcNpAqjS6fkpWCK5g8TA7xbC3muvN9FL9Pq0tcPUBLi3FH/sW4i23yVGp/YsXvZA4KDFvc8+MRqLWg==',key_name='tempest-keypair-1426333428',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0766e71864a4109b58d68e3eec4c67d',ramdisk_id='',reservation_id='r-rswcrczv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68302231-6837-4de4-88cf-f348cba7cb65',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1494896357',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1494896357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3d0732693c441a1a97dc18030f20573',uuid=e681f6b6-84b7-41c1-b1f7-0726ab0b8f93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4e87f77-2469-4b69-b84c-0f41266d2467", "address": "fa:16:3e:8d:f2:92", "network": {"id": "cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2066928365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0766e71864a4109b58d68e3eec4c67d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4e87f77-24", "ovs_interfaceid": "a4e87f77-2469-4b69-b84c-0f41266d2467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Converting VIF {"id": "a4e87f77-2469-4b69-b84c-0f41266d2467", "address": "fa:16:3e:8d:f2:92", "network": {"id": "cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2066928365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0766e71864a4109b58d68e3eec4c67d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4e87f77-24", "ovs_interfaceid": "a4e87f77-2469-4b69-b84c-0f41266d2467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:f2:92,bridge_name='br-int',has_traffic_filtering=True,id=a4e87f77-2469-4b69-b84c-0f41266d2467,network=Network(cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4e87f77-24') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG os_vif [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:f2:92,bridge_name='br-int',has_traffic_filtering=True,id=a4e87f77-2469-4b69-b84c-0f41266d2467,network=Network(cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4e87f77-24') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4e87f77-24, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:03 user nova-compute[72818]: INFO os_vif [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:f2:92,bridge_name='br-int',has_traffic_filtering=True,id=a4e87f77-2469-4b69-b84c-0f41266d2467,network=Network(cc61e0c0-4a5e-4d6f-8639-c4aa1ae51cb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4e87f77-24')
Aug 17 21:18:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Deleting instance files /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93_del
Aug 17 21:18:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Deletion of /opt/stack/data/nova/instances/e681f6b6-84b7-41c1-b1f7-0726ab0b8f93_del complete
Aug 17 21:18:03 user nova-compute[72818]: INFO nova.compute.manager [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 17 21:18:03 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:18:03 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:18:04 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updating instance_info_cache with network_info: [{"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:18:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Releasing lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:18:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f7d1aa5f-9a05-46bd-968b-85dd4a3b5f25 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "interface-796d2c15-1728-4cd2-a325-e9385556050f-d1fd1d06-a240-4248-bcbd-4ece6691d8a0" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.602s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2521a4a-284f-43bb-b7db-84fa079a7eb5 req-ceb8da56-4204-4b55-8733-d46e86dcfde5 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-vif-plugged-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2521a4a-284f-43bb-b7db-84fa079a7eb5 req-ceb8da56-4204-4b55-8733-d46e86dcfde5 service nova] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2521a4a-284f-43bb-b7db-84fa079a7eb5 req-ceb8da56-4204-4b55-8733-d46e86dcfde5 service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2521a4a-284f-43bb-b7db-84fa079a7eb5 req-ceb8da56-4204-4b55-8733-d46e86dcfde5 service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2521a4a-284f-43bb-b7db-84fa079a7eb5 req-ceb8da56-4204-4b55-8733-d46e86dcfde5 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] No waiting events found dispatching network-vif-plugged-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:04 user nova-compute[72818]: WARNING nova.compute.manager [req-d2521a4a-284f-43bb-b7db-84fa079a7eb5 req-ceb8da56-4204-4b55-8733-d46e86dcfde5 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received unexpected event network-vif-plugged-d1fd1d06-a240-4248-bcbd-4ece6691d8a0 for instance with vm_state active and task_state None.
Aug 17 21:18:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-18537993-e492-4df9-8974-6f7bd4120a39 req-a294ac42-ab4e-402d-b559-93b340cd7f90 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Received event network-vif-unplugged-a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-18537993-e492-4df9-8974-6f7bd4120a39 req-a294ac42-ab4e-402d-b559-93b340cd7f90 service nova] Acquiring lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-18537993-e492-4df9-8974-6f7bd4120a39 req-a294ac42-ab4e-402d-b559-93b340cd7f90 service nova] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-18537993-e492-4df9-8974-6f7bd4120a39 req-a294ac42-ab4e-402d-b559-93b340cd7f90 service nova] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-18537993-e492-4df9-8974-6f7bd4120a39 req-a294ac42-ab4e-402d-b559-93b340cd7f90 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] No waiting events found dispatching network-vif-unplugged-a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-18537993-e492-4df9-8974-6f7bd4120a39 req-a294ac42-ab4e-402d-b559-93b340cd7f90 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Received event network-vif-unplugged-a4e87f77-2469-4b69-b84c-0f41266d2467 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:18:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-18537993-e492-4df9-8974-6f7bd4120a39 req-a294ac42-ab4e-402d-b559-93b340cd7f90 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Received event network-vif-plugged-a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-18537993-e492-4df9-8974-6f7bd4120a39 req-a294ac42-ab4e-402d-b559-93b340cd7f90 service nova] Acquiring lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-18537993-e492-4df9-8974-6f7bd4120a39 req-a294ac42-ab4e-402d-b559-93b340cd7f90 service nova] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-18537993-e492-4df9-8974-6f7bd4120a39 req-a294ac42-ab4e-402d-b559-93b340cd7f90 service nova] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-18537993-e492-4df9-8974-6f7bd4120a39 req-a294ac42-ab4e-402d-b559-93b340cd7f90 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] No waiting events found dispatching network-vif-plugged-a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:05 user nova-compute[72818]: WARNING nova.compute.manager [req-18537993-e492-4df9-8974-6f7bd4120a39 req-a294ac42-ab4e-402d-b559-93b340cd7f90 service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Received unexpected event network-vif-plugged-a4e87f77-2469-4b69-b84c-0f41266d2467 for instance with vm_state active and task_state deleting.
Aug 17 21:18:05 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:18:05 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Took 1.83 seconds to deallocate network for instance.
Aug 17 21:18:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:06 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:18:06 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:18:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:06 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Deleted allocations for instance e681f6b6-84b7-41c1-b1f7-0726ab0b8f93
Aug 17 21:18:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-542b57b2-a6b5-47a3-ab51-e1e8b9df2d87 tempest-AttachSCSIVolumeTestJSON-1494896357 tempest-AttachSCSIVolumeTestJSON-1494896357-project-member] Lock "e681f6b6-84b7-41c1-b1f7-0726ab0b8f93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.469s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-d40c071d-21ba-4f19-a4dd-7c141dbe2af5 req-51a7043f-c1c1-4d7a-b583-1e4375fa4e3d service nova] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Received event network-vif-deleted-a4e87f77-2469-4b69-b84c-0f41266d2467 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:18:10 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Creating image(s)
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Ensure instance console log exists: /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Start _get_guest_xml network_info=[{"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '81779d39-d768-4c20-9bdd-59cfd0e7d59c', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrihzSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '827d6c12-deb5-4c05-ad6b-efba319783e9', 'attached_at': '', 'detached_at': '', 'volume_id': '5a9020bf-fade-4fea-a929-3910080fdf9a', 'serial': '5a9020bf-fade-4fea-a929-3910080fdf9a'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:18:10 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:18:10 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrihzSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:18:10 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:18:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:18:10 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:18:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:18:10 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e19781-55c0-4f8b-bee6-14304995a507]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:18:10 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60a2953-51ee-402c-8873-0ef021b2b5e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a] added
Aug 17 21:18:10 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fb344d-4c75-4540-abe9-d7bfe0487a5e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce461a7-7ecd-4c7c-9327-14a7ccec0d35]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrihzSXc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrihzSXc" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f8195f-2b8a-4b65-b3da-45181e81af2d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QrihzSXc'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f923c88-0ea3-4f27-b8e1-1eb516e8bbe5]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:18:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ee4c0b-9554-4d7e-9c0b-a703fe026b46]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:18:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:18:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3adf38-ad20-49f2-885d-b6169d6d84aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a, portal: 172.16.0.220,3260]
Aug 17 21:18:11 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a, portal: 172.16.0.220,3260] successful.
Aug 17 21:18:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d32708-3bbd-49c6-a058-3bbe60dd0c79]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfd8b76-3757-46ef-9845-a9f41dfadc25]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:18:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:18:11 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:18:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c640887-dacd-48f5-afdf-6a477a26bafa]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrihzSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:18:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23264343232313363', 'path': '/dev/sdh'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264343232313363', 'path': '/dev/sdh'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1276307221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1276307221',id=11,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-86p4d4ae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:17:48Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=827d6c12-deb5-4c05-ad6b-efba319783e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:d5:dd,bridge_name='br-int',has_traffic_filtering=True,id=67586c8a-e841-4778-891e-27307f1dbe67,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67586c8a-e8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG nova.objects.instance [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'pci_devices' on Instance uuid 827d6c12-deb5-4c05-ad6b-efba319783e9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:18:12 user nova-compute[72818]:   <uuid>827d6c12-deb5-4c05-ad6b-efba319783e9</uuid>
Aug 17 21:18:12 user nova-compute[72818]:   <name>instance-0000000b</name>
Aug 17 21:18:12 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:18:12 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:18:12 user nova-compute[72818]:   <metadata>
Aug 17 21:18:12 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:18:12 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:18:12 user nova-compute[72818]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1276307221</nova:name>
Aug 17 21:18:12 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:18:10</nova:creationTime>
Aug 17 21:18:12 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:18:12 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:18:12 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:18:12 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:18:12 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:18:12 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:18:12 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:18:12 user nova-compute[72818]:       <nova:owner>
Aug 17 21:18:12 user nova-compute[72818]:         <nova:user uuid="6cd1f219a2634975bb1362620392dc1a">tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member</nova:user>
Aug 17 21:18:12 user nova-compute[72818]:         <nova:project uuid="dda0b81a8a39436a9ec6e1646090f637">tempest-ServerBootFromVolumeStableRescueTest-1074783662</nova:project>
Aug 17 21:18:12 user nova-compute[72818]:       </nova:owner>
Aug 17 21:18:12 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:18:12 user nova-compute[72818]:       <nova:ports>
Aug 17 21:18:12 user nova-compute[72818]:         <nova:port uuid="67586c8a-e841-4778-891e-27307f1dbe67">
Aug 17 21:18:12 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 21:18:12 user nova-compute[72818]:         </nova:port>
Aug 17 21:18:12 user nova-compute[72818]:       </nova:ports>
Aug 17 21:18:12 user nova-compute[72818]:     </nova:instance>
Aug 17 21:18:12 user nova-compute[72818]:   </metadata>
Aug 17 21:18:12 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:18:12 user nova-compute[72818]:     <system>
Aug 17 21:18:12 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:18:12 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:18:12 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:18:12 user nova-compute[72818]:       <entry name="serial">827d6c12-deb5-4c05-ad6b-efba319783e9</entry>
Aug 17 21:18:12 user nova-compute[72818]:       <entry name="uuid">827d6c12-deb5-4c05-ad6b-efba319783e9</entry>
Aug 17 21:18:12 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:18:12 user nova-compute[72818]:     </system>
Aug 17 21:18:12 user nova-compute[72818]:   </sysinfo>
Aug 17 21:18:12 user nova-compute[72818]:   <os>
Aug 17 21:18:12 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:18:12 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:18:12 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:18:12 user nova-compute[72818]:   </os>
Aug 17 21:18:12 user nova-compute[72818]:   <features>
Aug 17 21:18:12 user nova-compute[72818]:     <acpi/>
Aug 17 21:18:12 user nova-compute[72818]:     <apic/>
Aug 17 21:18:12 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:18:12 user nova-compute[72818]:   </features>
Aug 17 21:18:12 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:18:12 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:18:12 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:18:12 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:18:12 user nova-compute[72818]:   </clock>
Aug 17 21:18:12 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:18:12 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:18:12 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:18:12 user nova-compute[72818]:   </cpu>
Aug 17 21:18:12 user nova-compute[72818]:   <devices>
Aug 17 21:18:12 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:18:12 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:18:12 user nova-compute[72818]:       <source dev="/dev/sdh"/>
Aug 17 21:18:12 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:18:12 user nova-compute[72818]:       <serial>5a9020bf-fade-4fea-a929-3910080fdf9a</serial>
Aug 17 21:18:12 user nova-compute[72818]:     </disk>
Aug 17 21:18:12 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:18:12 user nova-compute[72818]:       <mac address="fa:16:3e:5b:d5:dd"/>
Aug 17 21:18:12 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:18:12 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:18:12 user nova-compute[72818]:       <target dev="tap67586c8a-e8"/>
Aug 17 21:18:12 user nova-compute[72818]:     </interface>
Aug 17 21:18:12 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:18:12 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/console.log" append="off"/>
Aug 17 21:18:12 user nova-compute[72818]:     </serial>
Aug 17 21:18:12 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:18:12 user nova-compute[72818]:     <video>
Aug 17 21:18:12 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:18:12 user nova-compute[72818]:     </video>
Aug 17 21:18:12 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:18:12 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:18:12 user nova-compute[72818]:     </rng>
Aug 17 21:18:12 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:18:12 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:18:12 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:18:12 user nova-compute[72818]:     </memballoon>
Aug 17 21:18:12 user nova-compute[72818]:   </devices>
Aug 17 21:18:12 user nova-compute[72818]: </domain>
Aug 17 21:18:12 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1276307221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1276307221',id=11,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-86p4d4ae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:17:48Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=827d6c12-deb5-4c05-ad6b-efba319783e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:d5:dd,bridge_name='br-int',has_traffic_filtering=True,id=67586c8a-e841-4778-891e-27307f1dbe67,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67586c8a-e8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG os_vif [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:d5:dd,bridge_name='br-int',has_traffic_filtering=True,id=67586c8a-e841-4778-891e-27307f1dbe67,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67586c8a-e8') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67586c8a-e8, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67586c8a-e8, col_values=(('external_ids', {'iface-id': '67586c8a-e841-4778-891e-27307f1dbe67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:d5:dd', 'vm-uuid': '827d6c12-deb5-4c05-ad6b-efba319783e9'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:12 user nova-compute[72818]: INFO os_vif [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:d5:dd,bridge_name='br-int',has_traffic_filtering=True,id=67586c8a-e841-4778-891e-27307f1dbe67,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67586c8a-e8')
Aug 17 21:18:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:18:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No VIF found with MAC fa:16:3e:5b:d5:dd, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:18:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-15774bbb-abc0-4d12-92a1-6a381f67bf13 req-d3a7be86-8130-46cb-b388-5c01209b622a service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15774bbb-abc0-4d12-92a1-6a381f67bf13 req-d3a7be86-8130-46cb-b388-5c01209b622a service nova] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15774bbb-abc0-4d12-92a1-6a381f67bf13 req-d3a7be86-8130-46cb-b388-5c01209b622a service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15774bbb-abc0-4d12-92a1-6a381f67bf13 req-d3a7be86-8130-46cb-b388-5c01209b622a service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-15774bbb-abc0-4d12-92a1-6a381f67bf13 req-d3a7be86-8130-46cb-b388-5c01209b622a service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] No waiting events found dispatching network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:14 user nova-compute[72818]: WARNING nova.compute.manager [req-15774bbb-abc0-4d12-92a1-6a381f67bf13 req-d3a7be86-8130-46cb-b388-5c01209b622a service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received unexpected event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 for instance with vm_state building and task_state spawning.
Aug 17 21:18:15 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307095.9959414, 827d6c12-deb5-4c05-ad6b-efba319783e9 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:18:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] VM Resumed (Lifecycle Event)
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:18:16 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Instance spawned successfully.
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:16 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307095.997253, 827d6c12-deb5-4c05-ad6b-efba319783e9 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:18:16 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] VM Started (Lifecycle Event)
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:16 user nova-compute[72818]: INFO nova.compute.manager [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:16 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:18:16 user nova-compute[72818]: INFO nova.compute.manager [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Took 29.11 seconds to build instance.
Aug 17 21:18:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-edb858ec-4363-4dbd-b24b-cddc8cb81b77 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.216s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-09881eea-82b8-4eb4-867b-3837a2e2432d req-4e364eb0-018d-4844-bc49-633b05803ae0 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-09881eea-82b8-4eb4-867b-3837a2e2432d req-4e364eb0-018d-4844-bc49-633b05803ae0 service nova] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-09881eea-82b8-4eb4-867b-3837a2e2432d req-4e364eb0-018d-4844-bc49-633b05803ae0 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-09881eea-82b8-4eb4-867b-3837a2e2432d req-4e364eb0-018d-4844-bc49-633b05803ae0 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-09881eea-82b8-4eb4-867b-3837a2e2432d req-4e364eb0-018d-4844-bc49-633b05803ae0 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] No waiting events found dispatching network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:16 user nova-compute[72818]: WARNING nova.compute.manager [req-09881eea-82b8-4eb4-867b-3837a2e2432d req-4e364eb0-018d-4844-bc49-633b05803ae0 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received unexpected event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 for instance with vm_state active and task_state None.
Aug 17 21:18:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:18:17 user nova-compute[72818]: INFO nova.compute.claims [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Claim successful on node user
Aug 17 21:18:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:18:17 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:18:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG nova.policy [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c20e0d4b90694b09a71fc7790bb532df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18e542cdfb74711b0decf0c1f008e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:18:17 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Creating image(s)
Aug 17 21:18:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "/opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "/opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.187s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.168s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk 1073741824" returned: 0 in 0.051s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG nova.network.neutron [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Successfully created port: 25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Cannot resize image /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG nova.objects.instance [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'migration_context' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Ensure instance console log exists: /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:18 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307083.7647085, e681f6b6-84b7-41c1-b1f7-0726ab0b8f93 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:18:18 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] VM Stopped (Lifecycle Event)
Aug 17 21:18:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-6c86f6ef-a7a2-4cdf-8359-f36d5b0bb378 None None] [instance: e681f6b6-84b7-41c1-b1f7-0726ab0b8f93] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:19 user nova-compute[72818]: DEBUG nova.network.neutron [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Successfully updated port: 25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:18:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f2e2683-f00b-4b78-8bd2-4d28ae1247ed req-998d5634-db84-4746-a264-52ef01d91cef service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-changed-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-4f2e2683-f00b-4b78-8bd2-4d28ae1247ed req-998d5634-db84-4746-a264-52ef01d91cef service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Refreshing instance network info cache due to event network-changed-25efe920-cfdf-428d-86ee-0f9b8f301e11. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:18:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f2e2683-f00b-4b78-8bd2-4d28ae1247ed req-998d5634-db84-4746-a264-52ef01d91cef service nova] Acquiring lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:18:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f2e2683-f00b-4b78-8bd2-4d28ae1247ed req-998d5634-db84-4746-a264-52ef01d91cef service nova] Acquired lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:18:19 user nova-compute[72818]: DEBUG nova.network.neutron [req-4f2e2683-f00b-4b78-8bd2-4d28ae1247ed req-998d5634-db84-4746-a264-52ef01d91cef service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Refreshing network info cache for port 25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:18:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:18:19 user nova-compute[72818]: DEBUG nova.network.neutron [req-4f2e2683-f00b-4b78-8bd2-4d28ae1247ed req-998d5634-db84-4746-a264-52ef01d91cef service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.network.neutron [req-4f2e2683-f00b-4b78-8bd2-4d28ae1247ed req-998d5634-db84-4746-a264-52ef01d91cef service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4f2e2683-f00b-4b78-8bd2-4d28ae1247ed req-998d5634-db84-4746-a264-52ef01d91cef service nova] Releasing lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquired lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.network.neutron [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.network.neutron [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.network.neutron [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating instance_info_cache with network_info: [{"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Releasing lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance network_info: |[{"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Start _get_guest_xml network_info=[{"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:18:20 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:18:20 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949986485',display_name='tempest-ServerActionsTestOtherB-server-949986485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949986485',id=13,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRc64wH9u6dm3xi4kk/wBQ/vGvOzR5k+mWwsr3HttVU/OU3wMLvrRNNKLA460//NVqERVsDyz6LYVlThM/1o9Ih8+/vljt/Rg70GDESbu8oCMaWXuSfr3pfnG0YVMizwg==',key_name='tempest-keypair-722674119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a18e542cdfb74711b0decf0c1f008e0b',ramdisk_id='',reservation_id='r-jwckp96f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1842371167',owner_user_name='tempest-ServerActionsTestOtherB-1842371167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:18:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e0d4b90694b09a71fc7790bb532df',uuid=e8b5ccab-5dff-4458-a799-8c8528a032b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converting VIF {"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.objects.instance [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'pci_devices' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:18:20 user nova-compute[72818]:   <uuid>e8b5ccab-5dff-4458-a799-8c8528a032b1</uuid>
Aug 17 21:18:20 user nova-compute[72818]:   <name>instance-0000000d</name>
Aug 17 21:18:20 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:18:20 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:18:20 user nova-compute[72818]:   <metadata>
Aug 17 21:18:20 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:18:20 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:18:20 user nova-compute[72818]:       <nova:name>tempest-ServerActionsTestOtherB-server-949986485</nova:name>
Aug 17 21:18:20 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:18:20</nova:creationTime>
Aug 17 21:18:20 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:18:20 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:18:20 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:18:20 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:18:20 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:18:20 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:18:20 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:18:20 user nova-compute[72818]:       <nova:owner>
Aug 17 21:18:20 user nova-compute[72818]:         <nova:user uuid="c20e0d4b90694b09a71fc7790bb532df">tempest-ServerActionsTestOtherB-1842371167-project-member</nova:user>
Aug 17 21:18:20 user nova-compute[72818]:         <nova:project uuid="a18e542cdfb74711b0decf0c1f008e0b">tempest-ServerActionsTestOtherB-1842371167</nova:project>
Aug 17 21:18:20 user nova-compute[72818]:       </nova:owner>
Aug 17 21:18:20 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:18:20 user nova-compute[72818]:       <nova:ports>
Aug 17 21:18:20 user nova-compute[72818]:         <nova:port uuid="25efe920-cfdf-428d-86ee-0f9b8f301e11">
Aug 17 21:18:20 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 21:18:20 user nova-compute[72818]:         </nova:port>
Aug 17 21:18:20 user nova-compute[72818]:       </nova:ports>
Aug 17 21:18:20 user nova-compute[72818]:     </nova:instance>
Aug 17 21:18:20 user nova-compute[72818]:   </metadata>
Aug 17 21:18:20 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:18:20 user nova-compute[72818]:     <system>
Aug 17 21:18:20 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:18:20 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:18:20 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:18:20 user nova-compute[72818]:       <entry name="serial">e8b5ccab-5dff-4458-a799-8c8528a032b1</entry>
Aug 17 21:18:20 user nova-compute[72818]:       <entry name="uuid">e8b5ccab-5dff-4458-a799-8c8528a032b1</entry>
Aug 17 21:18:20 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:18:20 user nova-compute[72818]:     </system>
Aug 17 21:18:20 user nova-compute[72818]:   </sysinfo>
Aug 17 21:18:20 user nova-compute[72818]:   <os>
Aug 17 21:18:20 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:18:20 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:18:20 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:18:20 user nova-compute[72818]:   </os>
Aug 17 21:18:20 user nova-compute[72818]:   <features>
Aug 17 21:18:20 user nova-compute[72818]:     <acpi/>
Aug 17 21:18:20 user nova-compute[72818]:     <apic/>
Aug 17 21:18:20 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:18:20 user nova-compute[72818]:   </features>
Aug 17 21:18:20 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:18:20 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:18:20 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:18:20 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:18:20 user nova-compute[72818]:   </clock>
Aug 17 21:18:20 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:18:20 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:18:20 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:18:20 user nova-compute[72818]:   </cpu>
Aug 17 21:18:20 user nova-compute[72818]:   <devices>
Aug 17 21:18:20 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:18:20 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:18:20 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk"/>
Aug 17 21:18:20 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:18:20 user nova-compute[72818]:     </disk>
Aug 17 21:18:20 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:18:20 user nova-compute[72818]:       <mac address="fa:16:3e:ba:1c:1e"/>
Aug 17 21:18:20 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:18:20 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:18:20 user nova-compute[72818]:       <target dev="tap25efe920-cf"/>
Aug 17 21:18:20 user nova-compute[72818]:     </interface>
Aug 17 21:18:20 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:18:20 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/console.log" append="off"/>
Aug 17 21:18:20 user nova-compute[72818]:     </serial>
Aug 17 21:18:20 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:18:20 user nova-compute[72818]:     <video>
Aug 17 21:18:20 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:18:20 user nova-compute[72818]:     </video>
Aug 17 21:18:20 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:18:20 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:18:20 user nova-compute[72818]:     </rng>
Aug 17 21:18:20 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:18:20 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:18:20 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:18:20 user nova-compute[72818]:     </memballoon>
Aug 17 21:18:20 user nova-compute[72818]:   </devices>
Aug 17 21:18:20 user nova-compute[72818]: </domain>
Aug 17 21:18:20 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949986485',display_name='tempest-ServerActionsTestOtherB-server-949986485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949986485',id=13,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRc64wH9u6dm3xi4kk/wBQ/vGvOzR5k+mWwsr3HttVU/OU3wMLvrRNNKLA460//NVqERVsDyz6LYVlThM/1o9Ih8+/vljt/Rg70GDESbu8oCMaWXuSfr3pfnG0YVMizwg==',key_name='tempest-keypair-722674119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a18e542cdfb74711b0decf0c1f008e0b',ramdisk_id='',reservation_id='r-jwckp96f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1842371167',owner_user_name='tempest-ServerActionsTestOtherB-1842371167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:18:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e0d4b90694b09a71fc7790bb532df',uuid=e8b5ccab-5dff-4458-a799-8c8528a032b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converting VIF {"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG os_vif [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25efe920-cf, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25efe920-cf, col_values=(('external_ids', {'iface-id': '25efe920-cfdf-428d-86ee-0f9b8f301e11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:1c:1e', 'vm-uuid': 'e8b5ccab-5dff-4458-a799-8c8528a032b1'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:20 user nova-compute[72818]: INFO os_vif [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf')
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:18:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] No VIF found with MAC fa:16:3e:ba:1c:1e, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:18:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-7e2c1eb8-7e29-41a7-bd38-1180a9b58d5c req-48ce4585-c255-4f01-b152-cd84af0d00e2 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7e2c1eb8-7e29-41a7-bd38-1180a9b58d5c req-48ce4585-c255-4f01-b152-cd84af0d00e2 service nova] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7e2c1eb8-7e29-41a7-bd38-1180a9b58d5c req-48ce4585-c255-4f01-b152-cd84af0d00e2 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7e2c1eb8-7e29-41a7-bd38-1180a9b58d5c req-48ce4585-c255-4f01-b152-cd84af0d00e2 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-7e2c1eb8-7e29-41a7-bd38-1180a9b58d5c req-48ce4585-c255-4f01-b152-cd84af0d00e2 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] No waiting events found dispatching network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:22 user nova-compute[72818]: WARNING nova.compute.manager [req-7e2c1eb8-7e29-41a7-bd38-1180a9b58d5c req-48ce4585-c255-4f01-b152-cd84af0d00e2 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received unexpected event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 for instance with vm_state building and task_state spawning.
Aug 17 21:18:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307104.3341255, e8b5ccab-5dff-4458-a799-8c8528a032b1 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:18:24 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] VM Resumed (Lifecycle Event)
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:18:24 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance spawned successfully.
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:24 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307104.3357775, e8b5ccab-5dff-4458-a799-8c8528a032b1 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:18:24 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] VM Started (Lifecycle Event)
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-fc48b1b3-290c-40c2-8202-af16b43f3429 req-2ffcf412-92fb-4a01-8b87-7604ebfbd556 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc48b1b3-290c-40c2-8202-af16b43f3429 req-2ffcf412-92fb-4a01-8b87-7604ebfbd556 service nova] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc48b1b3-290c-40c2-8202-af16b43f3429 req-2ffcf412-92fb-4a01-8b87-7604ebfbd556 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc48b1b3-290c-40c2-8202-af16b43f3429 req-2ffcf412-92fb-4a01-8b87-7604ebfbd556 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-fc48b1b3-290c-40c2-8202-af16b43f3429 req-2ffcf412-92fb-4a01-8b87-7604ebfbd556 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] No waiting events found dispatching network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:24 user nova-compute[72818]: WARNING nova.compute.manager [req-fc48b1b3-290c-40c2-8202-af16b43f3429 req-2ffcf412-92fb-4a01-8b87-7604ebfbd556 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received unexpected event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 for instance with vm_state building and task_state spawning.
Aug 17 21:18:24 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:18:24 user nova-compute[72818]: INFO nova.compute.manager [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Took 6.58 seconds to spawn the instance on the hypervisor.
Aug 17 21:18:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:24 user nova-compute[72818]: INFO nova.compute.manager [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Took 7.40 seconds to build instance.
Aug 17 21:18:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34662fa4-95bd-47d1-869e-a1bc0f94e5fb tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.491s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:18:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:18:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:18:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:18:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "03cea654-4432-45b4-940b-64a55568f35a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "03cea654-4432-45b4-940b-64a55568f35a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:18:42 user nova-compute[72818]: INFO nova.compute.claims [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Claim successful on node user
Aug 17 21:18:42 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG nova.network.neutron [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:18:42 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:18:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG nova.policy [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a882239cd3054ad3abc93fd0b32a70c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f25ddb77be74b0184e1685cd0e34122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:18:42 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Creating image(s)
Aug 17 21:18:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "/opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "/opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "/opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk 1073741824" returned: 0 in 0.052s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG nova.network.neutron [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Successfully created port: 36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.200s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Cannot resize image /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG nova.objects.instance [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lazy-loading 'migration_context' on Instance uuid 03cea654-4432-45b4-940b-64a55568f35a {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Ensure instance console log exists: /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.network.neutron [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Successfully updated port: 36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "refresh_cache-03cea654-4432-45b4-940b-64a55568f35a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquired lock "refresh_cache-03cea654-4432-45b4-940b-64a55568f35a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.network.neutron [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.compute.manager [req-5f6b446d-c05b-4759-8012-8b1a1b7c174c req-3020ff22-d70c-4532-a6c2-d58b45535f6a service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Received event network-changed-36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.compute.manager [req-5f6b446d-c05b-4759-8012-8b1a1b7c174c req-3020ff22-d70c-4532-a6c2-d58b45535f6a service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Refreshing instance network info cache due to event network-changed-36c961a2-4391-461c-9726-f2d74f90b3c0. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5f6b446d-c05b-4759-8012-8b1a1b7c174c req-3020ff22-d70c-4532-a6c2-d58b45535f6a service nova] Acquiring lock "refresh_cache-03cea654-4432-45b4-940b-64a55568f35a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.network.neutron [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.network.neutron [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Updating instance_info_cache with network_info: [{"id": "36c961a2-4391-461c-9726-f2d74f90b3c0", "address": "fa:16:3e:17:33:e6", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c961a2-43", "ovs_interfaceid": "36c961a2-4391-461c-9726-f2d74f90b3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Releasing lock "refresh_cache-03cea654-4432-45b4-940b-64a55568f35a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Instance network_info: |[{"id": "36c961a2-4391-461c-9726-f2d74f90b3c0", "address": "fa:16:3e:17:33:e6", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c961a2-43", "ovs_interfaceid": "36c961a2-4391-461c-9726-f2d74f90b3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5f6b446d-c05b-4759-8012-8b1a1b7c174c req-3020ff22-d70c-4532-a6c2-d58b45535f6a service nova] Acquired lock "refresh_cache-03cea654-4432-45b4-940b-64a55568f35a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.network.neutron [req-5f6b446d-c05b-4759-8012-8b1a1b7c174c req-3020ff22-d70c-4532-a6c2-d58b45535f6a service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Refreshing network info cache for port 36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Start _get_guest_xml network_info=[{"id": "36c961a2-4391-461c-9726-f2d74f90b3c0", "address": "fa:16:3e:17:33:e6", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c961a2-43", "ovs_interfaceid": "36c961a2-4391-461c-9726-f2d74f90b3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:18:44 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:18:44 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-979517262',display_name='tempest-VolumesAdminNegativeTest-server-979517262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-979517262',id=14,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f25ddb77be74b0184e1685cd0e34122',ramdisk_id='',reservation_id='r-gg873won',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-342058843',owner_user_name='tempest-VolumesAdminNegativeTest-342058843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:18:43Z,user_data=None,user_id='a882239cd3054ad3abc93fd0b32a70c7',uuid=03cea654-4432-45b4-940b-64a55568f35a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36c961a2-4391-461c-9726-f2d74f90b3c0", "address": "fa:16:3e:17:33:e6", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c961a2-43", "ovs_interfaceid": "36c961a2-4391-461c-9726-f2d74f90b3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Converting VIF {"id": "36c961a2-4391-461c-9726-f2d74f90b3c0", "address": "fa:16:3e:17:33:e6", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c961a2-43", "ovs_interfaceid": "36c961a2-4391-461c-9726-f2d74f90b3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:33:e6,bridge_name='br-int',has_traffic_filtering=True,id=36c961a2-4391-461c-9726-f2d74f90b3c0,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c961a2-43') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.objects.instance [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lazy-loading 'pci_devices' on Instance uuid 03cea654-4432-45b4-940b-64a55568f35a {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:18:44 user nova-compute[72818]:   <uuid>03cea654-4432-45b4-940b-64a55568f35a</uuid>
Aug 17 21:18:44 user nova-compute[72818]:   <name>instance-0000000e</name>
Aug 17 21:18:44 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:18:44 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:18:44 user nova-compute[72818]:   <metadata>
Aug 17 21:18:44 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:18:44 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:18:44 user nova-compute[72818]:       <nova:name>tempest-VolumesAdminNegativeTest-server-979517262</nova:name>
Aug 17 21:18:44 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:18:44</nova:creationTime>
Aug 17 21:18:44 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:18:44 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:18:44 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:18:44 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:18:44 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:18:44 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:18:44 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:18:44 user nova-compute[72818]:       <nova:owner>
Aug 17 21:18:44 user nova-compute[72818]:         <nova:user uuid="a882239cd3054ad3abc93fd0b32a70c7">tempest-VolumesAdminNegativeTest-342058843-project-member</nova:user>
Aug 17 21:18:44 user nova-compute[72818]:         <nova:project uuid="0f25ddb77be74b0184e1685cd0e34122">tempest-VolumesAdminNegativeTest-342058843</nova:project>
Aug 17 21:18:44 user nova-compute[72818]:       </nova:owner>
Aug 17 21:18:44 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:18:44 user nova-compute[72818]:       <nova:ports>
Aug 17 21:18:44 user nova-compute[72818]:         <nova:port uuid="36c961a2-4391-461c-9726-f2d74f90b3c0">
Aug 17 21:18:44 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 21:18:44 user nova-compute[72818]:         </nova:port>
Aug 17 21:18:44 user nova-compute[72818]:       </nova:ports>
Aug 17 21:18:44 user nova-compute[72818]:     </nova:instance>
Aug 17 21:18:44 user nova-compute[72818]:   </metadata>
Aug 17 21:18:44 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:18:44 user nova-compute[72818]:     <system>
Aug 17 21:18:44 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:18:44 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:18:44 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:18:44 user nova-compute[72818]:       <entry name="serial">03cea654-4432-45b4-940b-64a55568f35a</entry>
Aug 17 21:18:44 user nova-compute[72818]:       <entry name="uuid">03cea654-4432-45b4-940b-64a55568f35a</entry>
Aug 17 21:18:44 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:18:44 user nova-compute[72818]:     </system>
Aug 17 21:18:44 user nova-compute[72818]:   </sysinfo>
Aug 17 21:18:44 user nova-compute[72818]:   <os>
Aug 17 21:18:44 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:18:44 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:18:44 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:18:44 user nova-compute[72818]:   </os>
Aug 17 21:18:44 user nova-compute[72818]:   <features>
Aug 17 21:18:44 user nova-compute[72818]:     <acpi/>
Aug 17 21:18:44 user nova-compute[72818]:     <apic/>
Aug 17 21:18:44 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:18:44 user nova-compute[72818]:   </features>
Aug 17 21:18:44 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:18:44 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:18:44 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:18:44 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:18:44 user nova-compute[72818]:   </clock>
Aug 17 21:18:44 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:18:44 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:18:44 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:18:44 user nova-compute[72818]:   </cpu>
Aug 17 21:18:44 user nova-compute[72818]:   <devices>
Aug 17 21:18:44 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:18:44 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:18:44 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk"/>
Aug 17 21:18:44 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:18:44 user nova-compute[72818]:     </disk>
Aug 17 21:18:44 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:18:44 user nova-compute[72818]:       <mac address="fa:16:3e:17:33:e6"/>
Aug 17 21:18:44 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:18:44 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:18:44 user nova-compute[72818]:       <target dev="tap36c961a2-43"/>
Aug 17 21:18:44 user nova-compute[72818]:     </interface>
Aug 17 21:18:44 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:18:44 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/console.log" append="off"/>
Aug 17 21:18:44 user nova-compute[72818]:     </serial>
Aug 17 21:18:44 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:18:44 user nova-compute[72818]:     <video>
Aug 17 21:18:44 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:18:44 user nova-compute[72818]:     </video>
Aug 17 21:18:44 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:18:44 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:18:44 user nova-compute[72818]:     </rng>
Aug 17 21:18:44 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:18:44 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:18:44 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:18:44 user nova-compute[72818]:     </memballoon>
Aug 17 21:18:44 user nova-compute[72818]:   </devices>
Aug 17 21:18:44 user nova-compute[72818]: </domain>
Aug 17 21:18:44 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-979517262',display_name='tempest-VolumesAdminNegativeTest-server-979517262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-979517262',id=14,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f25ddb77be74b0184e1685cd0e34122',ramdisk_id='',reservation_id='r-gg873won',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-342058843',owner_user_name='tempest-VolumesAdminNegativeTest-342058843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:18:43Z,user_data=None,user_id='a882239cd3054ad3abc93fd0b32a70c7',uuid=03cea654-4432-45b4-940b-64a55568f35a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36c961a2-4391-461c-9726-f2d74f90b3c0", "address": "fa:16:3e:17:33:e6", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c961a2-43", "ovs_interfaceid": "36c961a2-4391-461c-9726-f2d74f90b3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Converting VIF {"id": "36c961a2-4391-461c-9726-f2d74f90b3c0", "address": "fa:16:3e:17:33:e6", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c961a2-43", "ovs_interfaceid": "36c961a2-4391-461c-9726-f2d74f90b3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:33:e6,bridge_name='br-int',has_traffic_filtering=True,id=36c961a2-4391-461c-9726-f2d74f90b3c0,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c961a2-43') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG os_vif [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:33:e6,bridge_name='br-int',has_traffic_filtering=True,id=36c961a2-4391-461c-9726-f2d74f90b3c0,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c961a2-43') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36c961a2-43, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36c961a2-43, col_values=(('external_ids', {'iface-id': '36c961a2-4391-461c-9726-f2d74f90b3c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:33:e6', 'vm-uuid': '03cea654-4432-45b4-940b-64a55568f35a'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:44 user nova-compute[72818]: INFO os_vif [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:33:e6,bridge_name='br-int',has_traffic_filtering=True,id=36c961a2-4391-461c-9726-f2d74f90b3c0,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c961a2-43')
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:18:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] No VIF found with MAC fa:16:3e:17:33:e6, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:18:45 user nova-compute[72818]: DEBUG nova.network.neutron [req-5f6b446d-c05b-4759-8012-8b1a1b7c174c req-3020ff22-d70c-4532-a6c2-d58b45535f6a service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Updated VIF entry in instance network info cache for port 36c961a2-4391-461c-9726-f2d74f90b3c0. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:18:45 user nova-compute[72818]: DEBUG nova.network.neutron [req-5f6b446d-c05b-4759-8012-8b1a1b7c174c req-3020ff22-d70c-4532-a6c2-d58b45535f6a service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Updating instance_info_cache with network_info: [{"id": "36c961a2-4391-461c-9726-f2d74f90b3c0", "address": "fa:16:3e:17:33:e6", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c961a2-43", "ovs_interfaceid": "36c961a2-4391-461c-9726-f2d74f90b3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:18:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5f6b446d-c05b-4759-8012-8b1a1b7c174c req-3020ff22-d70c-4532-a6c2-d58b45535f6a service nova] Releasing lock "refresh_cache-03cea654-4432-45b4-940b-64a55568f35a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:18:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:46 user nova-compute[72818]: DEBUG nova.compute.manager [req-17fbbd85-3b23-45b1-a692-b22b1bc955c2 req-70a6714a-2322-4592-943d-870991f857e2 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Received event network-vif-plugged-36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-17fbbd85-3b23-45b1-a692-b22b1bc955c2 req-70a6714a-2322-4592-943d-870991f857e2 service nova] Acquiring lock "03cea654-4432-45b4-940b-64a55568f35a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-17fbbd85-3b23-45b1-a692-b22b1bc955c2 req-70a6714a-2322-4592-943d-870991f857e2 service nova] Lock "03cea654-4432-45b4-940b-64a55568f35a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-17fbbd85-3b23-45b1-a692-b22b1bc955c2 req-70a6714a-2322-4592-943d-870991f857e2 service nova] Lock "03cea654-4432-45b4-940b-64a55568f35a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:46 user nova-compute[72818]: DEBUG nova.compute.manager [req-17fbbd85-3b23-45b1-a692-b22b1bc955c2 req-70a6714a-2322-4592-943d-870991f857e2 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] No waiting events found dispatching network-vif-plugged-36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:46 user nova-compute[72818]: WARNING nova.compute.manager [req-17fbbd85-3b23-45b1-a692-b22b1bc955c2 req-70a6714a-2322-4592-943d-870991f857e2 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Received unexpected event network-vif-plugged-36c961a2-4391-461c-9726-f2d74f90b3c0 for instance with vm_state building and task_state spawning.
Aug 17 21:18:47 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:18:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:18:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:18:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:18:47 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307128.1895022, 03cea654-4432-45b4-940b-64a55568f35a => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:18:48 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 03cea654-4432-45b4-940b-64a55568f35a] VM Resumed (Lifecycle Event)
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:18:48 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Instance spawned successfully.
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:18:48 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 03cea654-4432-45b4-940b-64a55568f35a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307128.1909795, 03cea654-4432-45b4-940b-64a55568f35a => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:18:48 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 03cea654-4432-45b4-940b-64a55568f35a] VM Started (Lifecycle Event)
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:18:48 user nova-compute[72818]: INFO nova.compute.manager [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Took 5.50 seconds to spawn the instance on the hypervisor.
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:18:48 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 03cea654-4432-45b4-940b-64a55568f35a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:18:48 user nova-compute[72818]: INFO nova.compute.manager [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Took 6.33 seconds to build instance.
Aug 17 21:18:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41a81ce8-9b61-4fb8-939e-ff0deab0392c tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "03cea654-4432-45b4-940b-64a55568f35a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.428s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-c0c6bb32-a22a-4503-8a09-9b25b7654420 req-34037de4-6584-4ca1-8f44-f0245679e043 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Received event network-vif-plugged-36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c0c6bb32-a22a-4503-8a09-9b25b7654420 req-34037de4-6584-4ca1-8f44-f0245679e043 service nova] Acquiring lock "03cea654-4432-45b4-940b-64a55568f35a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c0c6bb32-a22a-4503-8a09-9b25b7654420 req-34037de4-6584-4ca1-8f44-f0245679e043 service nova] Lock "03cea654-4432-45b4-940b-64a55568f35a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c0c6bb32-a22a-4503-8a09-9b25b7654420 req-34037de4-6584-4ca1-8f44-f0245679e043 service nova] Lock "03cea654-4432-45b4-940b-64a55568f35a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-c0c6bb32-a22a-4503-8a09-9b25b7654420 req-34037de4-6584-4ca1-8f44-f0245679e043 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] No waiting events found dispatching network-vif-plugged-36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:48 user nova-compute[72818]: WARNING nova.compute.manager [req-c0c6bb32-a22a-4503-8a09-9b25b7654420 req-34037de4-6584-4ca1-8f44-f0245679e043 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Received unexpected event network-vif-plugged-36c961a2-4391-461c-9726-f2d74f90b3c0 for instance with vm_state active and task_state None.
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updating instance_info_cache with network_info: [{"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-796d2c15-1728-4cd2-a325-e9385556050f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:18:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:18:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:18:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:18:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:18:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:18:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:18:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:50 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:18:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:18:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:18:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "796d2c15-1728-4cd2-a325-e9385556050f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:52 user nova-compute[72818]: INFO nova.compute.manager [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Terminating instance
Aug 17 21:18:52 user nova-compute[72818]: DEBUG nova.compute.manager [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.compute.manager [req-7124b3e1-21cb-4069-8665-3f3632776564 req-9a0fdf8d-dbd3-4787-add9-44d03cd0ec42 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-vif-unplugged-5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7124b3e1-21cb-4069-8665-3f3632776564 req-9a0fdf8d-dbd3-4787-add9-44d03cd0ec42 service nova] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7124b3e1-21cb-4069-8665-3f3632776564 req-9a0fdf8d-dbd3-4787-add9-44d03cd0ec42 service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7124b3e1-21cb-4069-8665-3f3632776564 req-9a0fdf8d-dbd3-4787-add9-44d03cd0ec42 service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.compute.manager [req-7124b3e1-21cb-4069-8665-3f3632776564 req-9a0fdf8d-dbd3-4787-add9-44d03cd0ec42 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] No waiting events found dispatching network-vif-unplugged-5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.compute.manager [req-7124b3e1-21cb-4069-8665-3f3632776564 req-9a0fdf8d-dbd3-4787-add9-44d03cd0ec42 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-vif-unplugged-5e1c71f4-af86-4f7a-8dcf-0210699e469b for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:53 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Instance destroyed successfully.
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.objects.instance [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lazy-loading 'resources' on Instance uuid 796d2c15-1728-4cd2-a325-e9385556050f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178282304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178282304',id=4,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkwVGCdlBlVcOiwisZJ2m7rAADqLOL+kywXDgvAwR2qTgTTFDHWjasH/U7eolNcNHdZLXQQor9tYHlFwFKvEPgekkTkSGi0+Q6MQwEnZ2+/phVBP+RILBn2kgk74jej4g==',key_name='tempest-keypair-1982021055',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df7d5f3696b24e6a8c96af89e7316ead',ramdisk_id='',reservation_id='r-3sr5sqxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-330612610',owner_user_name='tempest-TaggedAttachmentsTest-330612610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e7e96b636034002b8994454bc89fdba',uuid=796d2c15-1728-4cd2-a325-e9385556050f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converting VIF {"id": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "address": "fa:16:3e:1c:94:f9", "network": {"id": "21f97a31-7cb5-43d0-b028-6b1a291f2285", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1306461182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df7d5f3696b24e6a8c96af89e7316ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1c71f4-af", "ovs_interfaceid": "5e1c71f4-af86-4f7a-8dcf-0210699e469b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:94:f9,bridge_name='br-int',has_traffic_filtering=True,id=5e1c71f4-af86-4f7a-8dcf-0210699e469b,network=Network(21f97a31-7cb5-43d0-b028-6b1a291f2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1c71f4-af') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG os_vif [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:94:f9,bridge_name='br-int',has_traffic_filtering=True,id=5e1c71f4-af86-4f7a-8dcf-0210699e469b,network=Network(21f97a31-7cb5-43d0-b028-6b1a291f2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1c71f4-af') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e1c71f4-af, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Acquiring lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Acquiring lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:53 user nova-compute[72818]: INFO os_vif [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:94:f9,bridge_name='br-int',has_traffic_filtering=True,id=5e1c71f4-af86-4f7a-8dcf-0210699e469b,network=Network(21f97a31-7cb5-43d0-b028-6b1a291f2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1c71f4-af')
Aug 17 21:18:53 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Deleting instance files /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f_del
Aug 17 21:18:53 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Deletion of /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f_del complete
Aug 17 21:18:53 user nova-compute[72818]: INFO nova.compute.manager [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Terminating instance
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json" returned: 1 in 0.214s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk --force-share --output=json' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:18:53 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000004, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/796d2c15-1728-4cd2-a325-e9385556050f/disk
Aug 17 21:18:53 user nova-compute[72818]: INFO nova.compute.manager [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG nova.compute.manager [req-a0664f97-f8a2-43e9-bbfa-3f785bc43719 req-d850b236-5946-493f-9454-2eab2fdd5023 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Received event network-vif-unplugged-5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0664f97-f8a2-43e9-bbfa-3f785bc43719 req-d850b236-5946-493f-9454-2eab2fdd5023 service nova] Acquiring lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0664f97-f8a2-43e9-bbfa-3f785bc43719 req-d850b236-5946-493f-9454-2eab2fdd5023 service nova] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0664f97-f8a2-43e9-bbfa-3f785bc43719 req-d850b236-5946-493f-9454-2eab2fdd5023 service nova] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG nova.compute.manager [req-a0664f97-f8a2-43e9-bbfa-3f785bc43719 req-d850b236-5946-493f-9454-2eab2fdd5023 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] No waiting events found dispatching network-vif-unplugged-5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG nova.compute.manager [req-a0664f97-f8a2-43e9-bbfa-3f785bc43719 req-d850b236-5946-493f-9454-2eab2fdd5023 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Received event network-vif-unplugged-5f2bc52b-9615-4568-a036-e17444ab271c for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:54 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Instance destroyed successfully.
Aug 17 21:18:54 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lazy-loading 'resources' on Instance uuid 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1264153588',display_name='tempest-VolumesAssistedSnapshotsTest-server-1264153588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1264153588',id=5,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXRRvDdkAHeKHjghkT7vExUmv/El2iD27TGtHWn3CdEkwUHQ6bU0336BWf+e5mxdVefA393sShZ3gA6fKQMaD5zQJcf4tJCJUjv2Zju4MI/VKAKPp29qpvg4FPpitZwrQ==',key_name='tempest-keypair-2068052004',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12e9f794f16e495787e5e4c98ae3e527',ramdisk_id='',reservation_id='r-4evjnzcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1436073668',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1436073668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b41b7c6bc78d41939615b278667f2f29',uuid=3ab89c6a-9eae-4091-b8ab-320f1544d6b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f2bc52b-9615-4568-a036-e17444ab271c", "address": "fa:16:3e:fa:ed:ba", "network": {"id": "a856cd30-6b1d-400d-82a6-051a5cb7391d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-375405083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e9f794f16e495787e5e4c98ae3e527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2bc52b-96", "ovs_interfaceid": "5f2bc52b-9615-4568-a036-e17444ab271c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Converting VIF {"id": "5f2bc52b-9615-4568-a036-e17444ab271c", "address": "fa:16:3e:fa:ed:ba", "network": {"id": "a856cd30-6b1d-400d-82a6-051a5cb7391d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-375405083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e9f794f16e495787e5e4c98ae3e527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2bc52b-96", "ovs_interfaceid": "5f2bc52b-9615-4568-a036-e17444ab271c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:ed:ba,bridge_name='br-int',has_traffic_filtering=True,id=5f2bc52b-9615-4568-a036-e17444ab271c,network=Network(a856cd30-6b1d-400d-82a6-051a5cb7391d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2bc52b-96') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG os_vif [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:ed:ba,bridge_name='br-int',has_traffic_filtering=True,id=5f2bc52b-9615-4568-a036-e17444ab271c,network=Network(a856cd30-6b1d-400d-82a6-051a5cb7391d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2bc52b-96') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f2bc52b-96, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:18:54 user nova-compute[72818]: INFO os_vif [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:ed:ba,bridge_name='br-int',has_traffic_filtering=True,id=5f2bc52b-9615-4568-a036-e17444ab271c,network=Network(a856cd30-6b1d-400d-82a6-051a5cb7391d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2bc52b-96')
Aug 17 21:18:54 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Deleting instance files /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9_del
Aug 17 21:18:54 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Deletion of /opt/stack/data/nova/instances/3ab89c6a-9eae-4091-b8ab-320f1544d6b9_del complete
Aug 17 21:18:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:54 user nova-compute[72818]: INFO nova.compute.manager [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 17 21:18:54 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:18:54 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-34f08792-eb36-4ccd-85a3-47604b129102 req-aec5f0e4-e1e7-450a-ac98-563143b418b6 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-vif-plugged-5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-34f08792-eb36-4ccd-85a3-47604b129102 req-aec5f0e4-e1e7-450a-ac98-563143b418b6 service nova] Acquiring lock "796d2c15-1728-4cd2-a325-e9385556050f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-34f08792-eb36-4ccd-85a3-47604b129102 req-aec5f0e4-e1e7-450a-ac98-563143b418b6 service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-34f08792-eb36-4ccd-85a3-47604b129102 req-aec5f0e4-e1e7-450a-ac98-563143b418b6 service nova] Lock "796d2c15-1728-4cd2-a325-e9385556050f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-34f08792-eb36-4ccd-85a3-47604b129102 req-aec5f0e4-e1e7-450a-ac98-563143b418b6 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] No waiting events found dispatching network-vif-plugged-5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:55 user nova-compute[72818]: WARNING nova.compute.manager [req-34f08792-eb36-4ccd-85a3-47604b129102 req-aec5f0e4-e1e7-450a-ac98-563143b418b6 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received unexpected event network-vif-plugged-5e1c71f4-af86-4f7a-8dcf-0210699e469b for instance with vm_state active and task_state deleting.
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:18:55 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:18:55 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7109MB free_disk=25.61147689819336GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:55 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Took 1.55 seconds to deallocate network for instance.
Aug 17 21:18:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b93c6b2f-59ee-4e7f-9805-97ef627eccdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 796d2c15-1728-4cd2-a325-e9385556050f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance a4618087-b551-4cc4-b50e-5276bb8395cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 279a0c9c-91a3-4c5b-8918-b1a9278b59ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b4a54471-2c50-435f-8e78-e5cdd1b41093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e8b5ccab-5dff-4458-a799-8c8528a032b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 03cea654-4432-45b4-940b-64a55568f35a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.556s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-31a884df-8b4e-4c65-884a-93a6d4b17e75 req-9d19bb94-1f92-438c-89a5-0c598b8c20a4 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Received event network-vif-plugged-5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-31a884df-8b4e-4c65-884a-93a6d4b17e75 req-9d19bb94-1f92-438c-89a5-0c598b8c20a4 service nova] Acquiring lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-31a884df-8b4e-4c65-884a-93a6d4b17e75 req-9d19bb94-1f92-438c-89a5-0c598b8c20a4 service nova] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-31a884df-8b4e-4c65-884a-93a6d4b17e75 req-9d19bb94-1f92-438c-89a5-0c598b8c20a4 service nova] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-31a884df-8b4e-4c65-884a-93a6d4b17e75 req-9d19bb94-1f92-438c-89a5-0c598b8c20a4 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] No waiting events found dispatching network-vif-plugged-5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:18:56 user nova-compute[72818]: WARNING nova.compute.manager [req-31a884df-8b4e-4c65-884a-93a6d4b17e75 req-9d19bb94-1f92-438c-89a5-0c598b8c20a4 service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Received unexpected event network-vif-plugged-5f2bc52b-9615-4568-a036-e17444ab271c for instance with vm_state active and task_state deleting.
Aug 17 21:18:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-31a884df-8b4e-4c65-884a-93a6d4b17e75 req-9d19bb94-1f92-438c-89a5-0c598b8c20a4 service nova] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Received event network-vif-deleted-5e1c71f4-af86-4f7a-8dcf-0210699e469b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:56 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Deleted allocations for instance 796d2c15-1728-4cd2-a325-e9385556050f
Aug 17 21:18:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-5708b54d-6b14-4ef1-b6eb-7755608ef98d req-01427d53-c2a6-4d98-8ddc-967c81b6d7b8 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Received event network-changed-b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-5708b54d-6b14-4ef1-b6eb-7755608ef98d req-01427d53-c2a6-4d98-8ddc-967c81b6d7b8 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Refreshing instance network info cache due to event network-changed-b1871d19-ffff-4ade-99b9-9e0355b5120a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5708b54d-6b14-4ef1-b6eb-7755608ef98d req-01427d53-c2a6-4d98-8ddc-967c81b6d7b8 service nova] Acquiring lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5708b54d-6b14-4ef1-b6eb-7755608ef98d req-01427d53-c2a6-4d98-8ddc-967c81b6d7b8 service nova] Acquired lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG nova.network.neutron [req-5708b54d-6b14-4ef1-b6eb-7755608ef98d req-01427d53-c2a6-4d98-8ddc-967c81b6d7b8 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Refreshing network info cache for port b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:18:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-218d45aa-5ed4-4bf8-a416-284af5966be9 tempest-TaggedAttachmentsTest-330612610 tempest-TaggedAttachmentsTest-330612610-project-member] Lock "796d2c15-1728-4cd2-a325-e9385556050f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.944s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:18:57 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Took 2.42 seconds to deallocate network for instance.
Aug 17 21:18:57 user nova-compute[72818]: DEBUG nova.network.neutron [req-5708b54d-6b14-4ef1-b6eb-7755608ef98d req-01427d53-c2a6-4d98-8ddc-967c81b6d7b8 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Updated VIF entry in instance network info cache for port b1871d19-ffff-4ade-99b9-9e0355b5120a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG nova.network.neutron [req-5708b54d-6b14-4ef1-b6eb-7755608ef98d req-01427d53-c2a6-4d98-8ddc-967c81b6d7b8 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Updating instance_info_cache with network_info: [{"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5708b54d-6b14-4ef1-b6eb-7755608ef98d req-01427d53-c2a6-4d98-8ddc-967c81b6d7b8 service nova] Releasing lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG nova.objects.instance [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lazy-loading 'flavor' on Instance uuid 48b00603-33ea-4eaa-b445-934ba1ab88f4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG nova.compute.manager [req-d6d12bb0-10ae-4c6d-a243-1a0bd1ddd2fe req-0d036859-66ef-436b-a194-88f61774759a service nova] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Received event network-vif-deleted-5f2bc52b-9615-4568-a036-e17444ab271c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:18:57 user nova-compute[72818]: INFO nova.compute.manager [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Attaching volume e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 to /dev/vdb
Aug 17 21:18:57 user nova-compute[72818]: DEBUG os_brick.utils [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b860b062-4b75-4d50-bd65-34a998811d05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bcf27e-c8f4-4ec3-bcf6-8c6d67d181e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ae70e0-549f-4fe0-a6d9-40fcbfba3069]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c83d0cc-1f8b-417d-933b-ae32b7d35a34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:18:57 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:18:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[adef2d72-d41a-475f-bb49-67bb58752600]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG os_brick.utils [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:18:57 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Updating existing volume attachment record: 59fb156c-eb03-4b30-b1b9-dcfe4b23b618 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:18:57 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Deleted allocations for instance 3ab89c6a-9eae-4091-b8ab-320f1544d6b9
Aug 17 21:18:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f95b8419-0408-41d5-8105-9bcf89bc28ca tempest-VolumesAssistedSnapshotsTest-1436073668 tempest-VolumesAssistedSnapshotsTest-1436073668-project-member] Lock "3ab89c6a-9eae-4091-b8ab-320f1544d6b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.398s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:18:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-ad1e1e77-a75a-419d-b69b-2f5e2a811943 req-448fee64-fb93-4e19-9435-7c8554957713 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-changed-fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:18:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-ad1e1e77-a75a-419d-b69b-2f5e2a811943 req-448fee64-fb93-4e19-9435-7c8554957713 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing instance network info cache due to event network-changed-fd598161-5c23-496b-a4bc-6014c311cede. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:18:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ad1e1e77-a75a-419d-b69b-2f5e2a811943 req-448fee64-fb93-4e19-9435-7c8554957713 service nova] Acquiring lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:18:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ad1e1e77-a75a-419d-b69b-2f5e2a811943 req-448fee64-fb93-4e19-9435-7c8554957713 service nova] Acquired lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:18:58 user nova-compute[72818]: DEBUG nova.network.neutron [req-ad1e1e77-a75a-419d-b69b-2f5e2a811943 req-448fee64-fb93-4e19-9435-7c8554957713 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Refreshing network info cache for port fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:18:59 user nova-compute[72818]: DEBUG nova.network.neutron [req-ad1e1e77-a75a-419d-b69b-2f5e2a811943 req-448fee64-fb93-4e19-9435-7c8554957713 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updated VIF entry in instance network info cache for port fd598161-5c23-496b-a4bc-6014c311cede. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:18:59 user nova-compute[72818]: DEBUG nova.network.neutron [req-ad1e1e77-a75a-419d-b69b-2f5e2a811943 req-448fee64-fb93-4e19-9435-7c8554957713 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating instance_info_cache with network_info: [{"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbc233f3-63c0-4529-aab0-fb00584462fb", "address": "fa:16:3e:7b:97:6f", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc233f3-63", "ovs_interfaceid": "fbc233f3-63c0-4529-aab0-fb00584462fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "428b6981-4fb9-4aab-8966-44c4079c7764", "address": "fa:16:3e:5d:55:fd", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428b6981-4f", "ovs_interfaceid": "428b6981-4fb9-4aab-8966-44c4079c7764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:18:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ad1e1e77-a75a-419d-b69b-2f5e2a811943 req-448fee64-fb93-4e19-9435-7c8554957713 service nova] Releasing lock "refresh_cache-a4618087-b551-4cc4-b50e-5276bb8395cd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:18:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:18:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:19:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:00 user nova-compute[72818]: INFO nova.compute.manager [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Terminating instance
Aug 17 21:19:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:19:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-d3c40bef-4346-4e19-80a3-03922c36f937 req-5d078002-dd4d-4c57-a96c-634fb93c27d3 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d3c40bef-4346-4e19-80a3-03922c36f937 req-5d078002-dd4d-4c57-a96c-634fb93c27d3 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d3c40bef-4346-4e19-80a3-03922c36f937 req-5d078002-dd4d-4c57-a96c-634fb93c27d3 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d3c40bef-4346-4e19-80a3-03922c36f937 req-5d078002-dd4d-4c57-a96c-634fb93c27d3 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-d3c40bef-4346-4e19-80a3-03922c36f937 req-5d078002-dd4d-4c57-a96c-634fb93c27d3 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-unplugged-fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-d3c40bef-4346-4e19-80a3-03922c36f937 req-5d078002-dd4d-4c57-a96c-634fb93c27d3 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-fd598161-5c23-496b-a4bc-6014c311cede for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-cda815d7-d637-48dd-9990-693440866195 req-691cea5d-8ef2-4fab-be31-2afc3e6281e7 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-1a5b3081-03b9-4b82-8470-5192e46ebad3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cda815d7-d637-48dd-9990-693440866195 req-691cea5d-8ef2-4fab-be31-2afc3e6281e7 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cda815d7-d637-48dd-9990-693440866195 req-691cea5d-8ef2-4fab-be31-2afc3e6281e7 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cda815d7-d637-48dd-9990-693440866195 req-691cea5d-8ef2-4fab-be31-2afc3e6281e7 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-cda815d7-d637-48dd-9990-693440866195 req-691cea5d-8ef2-4fab-be31-2afc3e6281e7 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-unplugged-1a5b3081-03b9-4b82-8470-5192e46ebad3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-cda815d7-d637-48dd-9990-693440866195 req-691cea5d-8ef2-4fab-be31-2afc3e6281e7 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-1a5b3081-03b9-4b82-8470-5192e46ebad3 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Instance destroyed successfully.
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.objects.instance [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lazy-loading 'resources' on Instance uuid a4618087-b551-4cc4-b50e-5276bb8395cd {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:e7:63,bridge_name='br-int',has_traffic_filtering=True,id=fd598161-5c23-496b-a4bc-6014c311cede,network=Network(3c0386bc-b1c7-4730-a896-e935a72c6e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd598161-5c') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:e7:63,bridge_name='br-int',has_traffic_filtering=True,id=fd598161-5c23-496b-a4bc-6014c311cede,network=Network(3c0386bc-b1c7-4730-a896-e935a72c6e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd598161-5c') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd598161-5c, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: INFO os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:e7:63,bridge_name='br-int',has_traffic_filtering=True,id=fd598161-5c23-496b-a4bc-6014c311cede,network=Network(3c0386bc-b1c7-4730-a896-e935a72c6e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd598161-5c')
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:21:0a,bridge_name='br-int',has_traffic_filtering=True,id=8ceb5790-78d9-4df8-ac63-f5607672129a,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ceb5790-78') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:21:0a,bridge_name='br-int',has_traffic_filtering=True,id=8ceb5790-78d9-4df8-ac63-f5607672129a,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ceb5790-78') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ceb5790-78, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: INFO os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:21:0a,bridge_name='br-int',has_traffic_filtering=True,id=8ceb5790-78d9-4df8-ac63-f5607672129a,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ceb5790-78')
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cf:24,bridge_name='br-int',has_traffic_filtering=True,id=1a5b3081-03b9-4b82-8470-5192e46ebad3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1a5b3081-03') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cf:24,bridge_name='br-int',has_traffic_filtering=True,id=1a5b3081-03b9-4b82-8470-5192e46ebad3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1a5b3081-03') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a5b3081-03, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: INFO os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cf:24,bridge_name='br-int',has_traffic_filtering=True,id=1a5b3081-03b9-4b82-8470-5192e46ebad3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1a5b3081-03')
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbc233f3-63c0-4529-aab0-fb00584462fb", "address": "fa:16:3e:7b:97:6f", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc233f3-63", "ovs_interfaceid": "fbc233f3-63c0-4529-aab0-fb00584462fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "fbc233f3-63c0-4529-aab0-fb00584462fb", "address": "fa:16:3e:7b:97:6f", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc233f3-63", "ovs_interfaceid": "fbc233f3-63c0-4529-aab0-fb00584462fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:97:6f,bridge_name='br-int',has_traffic_filtering=True,id=fbc233f3-63c0-4529-aab0-fb00584462fb,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc233f3-63') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:97:6f,bridge_name='br-int',has_traffic_filtering=True,id=fbc233f3-63c0-4529-aab0-fb00584462fb,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc233f3-63') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbc233f3-63, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: INFO os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:97:6f,bridge_name='br-int',has_traffic_filtering=True,id=fbc233f3-63c0-4529-aab0-fb00584462fb,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc233f3-63')
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:63,bridge_name='br-int',has_traffic_filtering=True,id=4547ebf9-7d38-4301-bf48-b7d0cbb109c3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4547ebf9-7d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:63,bridge_name='br-int',has_traffic_filtering=True,id=4547ebf9-7d38-4301-bf48-b7d0cbb109c3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4547ebf9-7d') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4547ebf9-7d, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: INFO os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:63,bridge_name='br-int',has_traffic_filtering=True,id=4547ebf9-7d38-4301-bf48-b7d0cbb109c3,network=Network(0120a1ae-e117-4d3a-a57a-85c6fefba307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4547ebf9-7d')
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:60:81,bridge_name='br-int',has_traffic_filtering=True,id=4f0c45d2-1343-43b8-aadc-53b2229dacd0,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f0c45d2-13') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:60:81,bridge_name='br-int',has_traffic_filtering=True,id=4f0c45d2-1343-43b8-aadc-53b2229dacd0,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f0c45d2-13') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f0c45d2-13, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: INFO os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:60:81,bridge_name='br-int',has_traffic_filtering=True,id=4f0c45d2-1343-43b8-aadc-53b2229dacd0,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f0c45d2-13')
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801175330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801175330',id=8,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjBIeQkbR5jDIQcBbSflIwJ0o55BG9GKYbL93odZdQN9FL3rSk/5KjRQflcgnPXvODiesjIBKd7Zcess8u3fmnoYHFSepSlA6itSdFUqhjDSDmbRS0aFeoZtFbHSydPw==',key_name='tempest-keypair-818747747',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d73943c144849fbb868c847e85b1a3b',ramdisk_id='',reservation_id='r-84lsmhqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-543470781',owner_user_name='tempest-TaggedBootDevicesTest-543470781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b48b80cf5744a4c94316cfcc3b85f6a',uuid=a4618087-b551-4cc4-b50e-5276bb8395cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "428b6981-4fb9-4aab-8966-44c4079c7764", "address": "fa:16:3e:5d:55:fd", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428b6981-4f", "ovs_interfaceid": "428b6981-4fb9-4aab-8966-44c4079c7764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converting VIF {"id": "428b6981-4fb9-4aab-8966-44c4079c7764", "address": "fa:16:3e:5d:55:fd", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428b6981-4f", "ovs_interfaceid": "428b6981-4fb9-4aab-8966-44c4079c7764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:55:fd,bridge_name='br-int',has_traffic_filtering=True,id=428b6981-4fb9-4aab-8966-44c4079c7764,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428b6981-4f') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:55:fd,bridge_name='br-int',has_traffic_filtering=True,id=428b6981-4fb9-4aab-8966-44c4079c7764,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428b6981-4f') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap428b6981-4f, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:02 user nova-compute[72818]: INFO os_vif [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:55:fd,bridge_name='br-int',has_traffic_filtering=True,id=428b6981-4fb9-4aab-8966-44c4079c7764,network=Network(6b52997e-a9b1-4416-9153-0b8991aad6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428b6981-4f')
Aug 17 21:19:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMKGpCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:19:02 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:19:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f795ad-d47e-44cc-b67d-3969d2938f05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[796b4fbe-059d-46a8-a817-7f6fa8ee0345]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04e04f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e'): ({'sde'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Removing single pathed devices sde {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[99268b17-337c-4f5a-97b9-9610965091da]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[44273b8c-a1fa-4ef1-b357-0c68c152bc60]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Flushing IO for device /dev/sde {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaee8e4b-c681-4bad-9d46-e7ea726224d6]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:03 user nova-compute[72818]: WARNING nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-fd598161-5c23-496b-a4bc-6014c311cede for instance with vm_state active and task_state deleting.
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-8ceb5790-78d9-4df8-ac63-f5607672129a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-unplugged-8ceb5790-78d9-4df8-ac63-f5607672129a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-8ceb5790-78d9-4df8-ac63-f5607672129a for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-8ceb5790-78d9-4df8-ac63-f5607672129a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-8ceb5790-78d9-4df8-ac63-f5607672129a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:03 user nova-compute[72818]: WARNING nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-8ceb5790-78d9-4df8-ac63-f5607672129a for instance with vm_state active and task_state deleting.
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-unplugged-fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-fbc233f3-63c0-4529-aab0-fb00584462fb for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:03 user nova-compute[72818]: WARNING nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-fbc233f3-63c0-4529-aab0-fb00584462fb for instance with vm_state active and task_state deleting.
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-unplugged-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:03 user nova-compute[72818]: WARNING nova.compute.manager [req-303a6a5d-9463-4509-8b97-817a1542d5cd req-afa8bc20-800e-4fac-b6d7-de1866075f25 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 for instance with vm_state active and task_state deleting.
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ed6cd5-0105-4720-b78c-5296d88bf218]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] SCSI volumes sde have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb13a95-37e0-4632-babc-e3763948152b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1523aeb-8fd0-41c7-ab61-5616dfaec93d]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e, portal: 172.16.0.220,3260]
Aug 17 21:19:03 user nova-compute[72818]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e, portal: 172.16.0.220,3260] successful.
Aug 17 21:19:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db0bd26-6a04-4259-aaa1-144cd0864d1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ca0aa6-d4ae-4127-81df-14dc1817cc2a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] <== disconnect_volume: return (394ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFVKANHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:19:03 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6c1092-a2e3-47fd-8972-334c8d38db33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-1a5b3081-03b9-4b82-8470-5192e46ebad3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-1a5b3081-03b9-4b82-8470-5192e46ebad3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:03 user nova-compute[72818]: WARNING nova.compute.manager [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-1a5b3081-03b9-4b82-8470-5192e46ebad3 for instance with vm_state active and task_state deleting.
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-unplugged-4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-4f0c45d2-1343-43b8-aadc-53b2229dacd0 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:03 user nova-compute[72818]: WARNING nova.compute.manager [req-ee1b2e32-5595-4d7b-9df3-a5160ba1b3c2 req-52a3f767-9aa2-432e-a9e5-f629a3862b4b service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-4f0c45d2-1343-43b8-aadc-53b2229dacd0 for instance with vm_state active and task_state deleting.
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3774c5-d773-4cae-bfb2-403cb42fdc1c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fb4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46'): ({'sdc'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Removing single pathed devices sdc {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a454cd8-9e13-4471-b543-66ac2880a3c1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[26160b39-69db-451e-99e4-f578ebc475e7]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Flushing IO for device /dev/sdc {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f095fb-8045-4dee-b073-eb1e5db2295d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab898e4-f7e7-485b-964c-b6a2573073b3]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0bcdd0-953f-4757-8938-1be5a4179d7f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.167s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2775edd6-c3b2-4f1f-a440-46e14e8f3814]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46, portal: 172.16.0.220,3260]
Aug 17 21:19:03 user nova-compute[72818]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46, portal: 172.16.0.220,3260] successful.
Aug 17 21:19:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79478458-0a3e-42eb-921c-b86a47887e46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d904b4-0ffe-4496-8776-7f9d58ec592a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] <== disconnect_volume: return (450ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXxrdsyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:19:03 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd7f4d9-a5be-4d1b-94ab-a4e011e8265c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f1998c-1cc4-4676-b0df-a8932e89940b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:03 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:19:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fb4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[21901489-ea20-4947-81c1-4962434fef20]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bafcf72-bcb7-49ff-81e8-b416736b9d6f]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb2c7ab-d86e-49af-9e40-904dcd904a25]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:19:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e700e9e9-33ad-4369-b222-12d040756ca4]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e6f83b-213a-4d97-b644-28fa69ef55fc]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee424c1-8080-41b7-9c99-4c61bb8936ce]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466, portal: 172.16.0.220,3260]
Aug 17 21:19:04 user nova-compute[72818]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466, portal: 172.16.0.220,3260] successful.
Aug 17 21:19:04 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdeb5eb2-02ce-4b50-9da6-11730d812466 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab0b656-efac-476a-bb1a-f5b11347b3e7]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] <== disconnect_volume: return (308ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:19:04 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Deleting instance files /opt/stack/data/nova/instances/a4618087-b551-4cc4-b50e-5276bb8395cd_del
Aug 17 21:19:04 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Deletion of /opt/stack/data/nova/instances/a4618087-b551-4cc4-b50e-5276bb8395cd_del complete
Aug 17 21:19:04 user nova-compute[72818]: INFO nova.compute.manager [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Took 3.56 seconds to destroy the instance on the hypervisor.
Aug 17 21:19:04 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:19:04 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:19:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-d1263af5-84c9-48ab-a06e-5713b3683351 req-b00fad66-dbba-4d21-8996-4b8de9c456a9 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d1263af5-84c9-48ab-a06e-5713b3683351 req-b00fad66-dbba-4d21-8996-4b8de9c456a9 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d1263af5-84c9-48ab-a06e-5713b3683351 req-b00fad66-dbba-4d21-8996-4b8de9c456a9 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d1263af5-84c9-48ab-a06e-5713b3683351 req-b00fad66-dbba-4d21-8996-4b8de9c456a9 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-d1263af5-84c9-48ab-a06e-5713b3683351 req-b00fad66-dbba-4d21-8996-4b8de9c456a9 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-unplugged-428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-d1263af5-84c9-48ab-a06e-5713b3683351 req-b00fad66-dbba-4d21-8996-4b8de9c456a9 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-unplugged-428b6981-4fb9-4aab-8966-44c4079c7764 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-d1263af5-84c9-48ab-a06e-5713b3683351 req-b00fad66-dbba-4d21-8996-4b8de9c456a9 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-plugged-428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d1263af5-84c9-48ab-a06e-5713b3683351 req-b00fad66-dbba-4d21-8996-4b8de9c456a9 service nova] Acquiring lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d1263af5-84c9-48ab-a06e-5713b3683351 req-b00fad66-dbba-4d21-8996-4b8de9c456a9 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d1263af5-84c9-48ab-a06e-5713b3683351 req-b00fad66-dbba-4d21-8996-4b8de9c456a9 service nova] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-d1263af5-84c9-48ab-a06e-5713b3683351 req-b00fad66-dbba-4d21-8996-4b8de9c456a9 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] No waiting events found dispatching network-vif-plugged-428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:05 user nova-compute[72818]: WARNING nova.compute.manager [req-d1263af5-84c9-48ab-a06e-5713b3683351 req-b00fad66-dbba-4d21-8996-4b8de9c456a9 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received unexpected event network-vif-plugged-428b6981-4fb9-4aab-8966-44c4079c7764 for instance with vm_state active and task_state deleting.
Aug 17 21:19:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-8bbd0586-54b1-4682-802a-634f09dcfd0d req-1726721d-a733-4d8f-8ec6-98a92067fbd8 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-deleted-fbc233f3-63c0-4529-aab0-fb00584462fb {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:07 user nova-compute[72818]: INFO nova.compute.manager [req-8bbd0586-54b1-4682-802a-634f09dcfd0d req-1726721d-a733-4d8f-8ec6-98a92067fbd8 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Neutron deleted interface fbc233f3-63c0-4529-aab0-fb00584462fb; detaching it from the instance and deleting it from the info cache
Aug 17 21:19:07 user nova-compute[72818]: DEBUG nova.network.neutron [req-8bbd0586-54b1-4682-802a-634f09dcfd0d req-1726721d-a733-4d8f-8ec6-98a92067fbd8 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating instance_info_cache with network_info: [{"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "428b6981-4fb9-4aab-8966-44c4079c7764", "address": "fa:16:3e:5d:55:fd", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428b6981-4f", "ovs_interfaceid": "428b6981-4fb9-4aab-8966-44c4079c7764", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-8bbd0586-54b1-4682-802a-634f09dcfd0d req-1726721d-a733-4d8f-8ec6-98a92067fbd8 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Detach interface failed, port_id=fbc233f3-63c0-4529-aab0-fb00584462fb, reason: Instance a4618087-b551-4cc4-b50e-5276bb8395cd could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:19:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-8bbd0586-54b1-4682-802a-634f09dcfd0d req-1726721d-a733-4d8f-8ec6-98a92067fbd8 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-deleted-428b6981-4fb9-4aab-8966-44c4079c7764 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:07 user nova-compute[72818]: INFO nova.compute.manager [req-8bbd0586-54b1-4682-802a-634f09dcfd0d req-1726721d-a733-4d8f-8ec6-98a92067fbd8 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Neutron deleted interface 428b6981-4fb9-4aab-8966-44c4079c7764; detaching it from the instance and deleting it from the info cache
Aug 17 21:19:07 user nova-compute[72818]: DEBUG nova.network.neutron [req-8bbd0586-54b1-4682-802a-634f09dcfd0d req-1726721d-a733-4d8f-8ec6-98a92067fbd8 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating instance_info_cache with network_info: [{"id": "fd598161-5c23-496b-a4bc-6014c311cede", "address": "fa:16:3e:81:e7:63", "network": {"id": "3c0386bc-b1c7-4730-a896-e935a72c6e34", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1790343813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd598161-5c", "ovs_interfaceid": "fd598161-5c23-496b-a4bc-6014c311cede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ceb5790-78d9-4df8-ac63-f5607672129a", "address": "fa:16:3e:aa:21:0a", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ceb5790-78", "ovs_interfaceid": "8ceb5790-78d9-4df8-ac63-f5607672129a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "address": "fa:16:3e:d8:cf:24", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a5b3081-03", "ovs_interfaceid": "1a5b3081-03b9-4b82-8470-5192e46ebad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "address": "fa:16:3e:d5:4a:63", "network": {"id": "0120a1ae-e117-4d3a-a57a-85c6fefba307", "bridge": "br-int", "label": "tempest-device-tagging-net1-999614183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4547ebf9-7d", "ovs_interfaceid": "4547ebf9-7d38-4301-bf48-b7d0cbb109c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "address": "fa:16:3e:69:60:81", "network": {"id": "6b52997e-a9b1-4416-9153-0b8991aad6d5", "bridge": "br-int", "label": "tempest-device-tagging-net2-520024057", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d73943c144849fbb868c847e85b1a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f0c45d2-13", "ovs_interfaceid": "4f0c45d2-1343-43b8-aadc-53b2229dacd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-8bbd0586-54b1-4682-802a-634f09dcfd0d req-1726721d-a733-4d8f-8ec6-98a92067fbd8 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Detach interface failed, port_id=428b6981-4fb9-4aab-8966-44c4079c7764, reason: Instance a4618087-b551-4cc4-b50e-5276bb8395cd could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:19:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:08 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:08 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Took 3.99 seconds to deallocate network for instance.
Aug 17 21:19:08 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307133.5470433, 796d2c15-1728-4cd2-a325-e9385556050f => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:19:08 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] VM Stopped (Lifecycle Event)
Aug 17 21:19:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-cc5eada2-3ae3-49b1-99ab-2b33e6142a57 None None] [instance: 796d2c15-1728-4cd2-a325-e9385556050f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-75bd8048-b16e-4bfa-a994-85d680eea743 req-d2b8551a-052d-419e-b4a8-ebb38a0fb968 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-deleted-fd598161-5c23-496b-a4bc-6014c311cede {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-75bd8048-b16e-4bfa-a994-85d680eea743 req-d2b8551a-052d-419e-b4a8-ebb38a0fb968 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-deleted-4547ebf9-7d38-4301-bf48-b7d0cbb109c3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-75bd8048-b16e-4bfa-a994-85d680eea743 req-d2b8551a-052d-419e-b4a8-ebb38a0fb968 service nova] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Received event network-vif-deleted-4f0c45d2-1343-43b8-aadc-53b2229dacd0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:09 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307134.5124223, 3ab89c6a-9eae-4091-b8ab-320f1544d6b9 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:19:09 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] VM Stopped (Lifecycle Event)
Aug 17 21:19:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-235d087b-5079-4d6e-8d81-c83d565f2935 None None] [instance: 3ab89c6a-9eae-4091-b8ab-320f1544d6b9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-df2713be-3022-4c4a-9adc-928f8529d549 req-0b106160-9273-45fb-abe0-c7b0dab7c798 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-changed-69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-df2713be-3022-4c4a-9adc-928f8529d549 req-0b106160-9273-45fb-abe0-c7b0dab7c798 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing instance network info cache due to event network-changed-69dadb43-0aba-4637-a9ac-b7214b9f37b0. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:19:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-df2713be-3022-4c4a-9adc-928f8529d549 req-0b106160-9273-45fb-abe0-c7b0dab7c798 service nova] Acquiring lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:19:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-df2713be-3022-4c4a-9adc-928f8529d549 req-0b106160-9273-45fb-abe0-c7b0dab7c798 service nova] Acquired lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:19:10 user nova-compute[72818]: DEBUG nova.network.neutron [req-df2713be-3022-4c4a-9adc-928f8529d549 req-0b106160-9273-45fb-abe0-c7b0dab7c798 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Refreshing network info cache for port 69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:19:10 user nova-compute[72818]: INFO nova.compute.manager [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Took 2.58 seconds to detach 3 volumes for instance.
Aug 17 21:19:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:10 user nova-compute[72818]: DEBUG nova.network.neutron [req-df2713be-3022-4c4a-9adc-928f8529d549 req-0b106160-9273-45fb-abe0-c7b0dab7c798 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updated VIF entry in instance network info cache for port 69dadb43-0aba-4637-a9ac-b7214b9f37b0. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:19:10 user nova-compute[72818]: DEBUG nova.network.neutron [req-df2713be-3022-4c4a-9adc-928f8529d549 req-0b106160-9273-45fb-abe0-c7b0dab7c798 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [{"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "address": "fa:16:3e:9b:c5:5d", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b783d7f-a2", "ovs_interfaceid": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-df2713be-3022-4c4a-9adc-928f8529d549 req-0b106160-9273-45fb-abe0-c7b0dab7c798 service nova] Releasing lock "refresh_cache-279a0c9c-91a3-4c5b-8918-b1a9278b59ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:11 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Deleted allocations for instance a4618087-b551-4cc4-b50e-5276bb8395cd
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04534f88-2a00-4e97-8478-5ee2a04f4908 tempest-TaggedBootDevicesTest-543470781 tempest-TaggedBootDevicesTest-543470781-project-member] Lock "a4618087-b551-4cc4-b50e-5276bb8395cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.687s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JYDALhlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:19:11 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:11 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:11 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47fef8f-124c-46e3-bb0e-c78cadba58c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:19:11 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a13414-d7aa-413b-8d7e-8030277e513f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0] added
Aug 17 21:19:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f1cdb9-fc44-403f-ac52-41f5bd81bc2d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e491a1e-9d21-4a2b-ad39-18536560ad59]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JYDALhlG {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JYDALhlG" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d552f42c-d64c-4f3b-a0cb-13f186a78f91]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JYDALhlG'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[db47fee1-7329-45b6-b911-80f3e4a9ab62]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fd6a61-b0d1-410c-a62d-5f7a74bd8d06]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:19:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:19:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec1bc7d-a51e-49c6-8164-6cb85f2bf428]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0, portal: 172.16.0.220,3260]
Aug 17 21:19:11 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0, portal: 172.16.0.220,3260] successful.
Aug 17 21:19:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ea6339-3f7a-4333-a042-b36eb9b5463c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25babb3-8f0e-4717-90a8-e796dccd82fd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:19:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:11 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:19:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cb04eb-e8e6-45c0-b834-0d64a18bbb17]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:19:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JYDALhlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:19:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23663653062316665', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:19:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663653062316665', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:19:12 user nova-compute[72818]: DEBUG nova.objects.instance [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lazy-loading 'flavor' on Instance uuid 48b00603-33ea-4eaa-b445-934ba1ab88f4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:19:12 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:19:12 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:19:12 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:19:12 user nova-compute[72818]:   <serial>e0f5f321-d2d0-4c74-9b9c-ca06667cebb0</serial>
Aug 17 21:19:12 user nova-compute[72818]: </disk>
Aug 17 21:19:12 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:19:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:13 user nova-compute[72818]: INFO nova.compute.manager [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Terminating instance
Aug 17 21:19:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] No VIF found with MAC fa:16:3e:97:44:93, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a7ad763c-cea6-4558-963a-f4fd8de05f2e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.032s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-361a459a-f30a-44b5-ba16-f5d02613ace0 req-5a158843-554a-4b53-9faa-d55c4d7d3b6e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-361a459a-f30a-44b5-ba16-f5d02613ace0 req-5a158843-554a-4b53-9faa-d55c4d7d3b6e service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-361a459a-f30a-44b5-ba16-f5d02613ace0 req-5a158843-554a-4b53-9faa-d55c4d7d3b6e service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-361a459a-f30a-44b5-ba16-f5d02613ace0 req-5a158843-554a-4b53-9faa-d55c4d7d3b6e service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-361a459a-f30a-44b5-ba16-f5d02613ace0 req-5a158843-554a-4b53-9faa-d55c4d7d3b6e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-unplugged-69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-361a459a-f30a-44b5-ba16-f5d02613ace0 req-5a158843-554a-4b53-9faa-d55c4d7d3b6e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-69dadb43-0aba-4637-a9ac-b7214b9f37b0 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-d8d479cd-df88-4583-bf78-b5296050e065 req-49e6e580-1219-43aa-ac6c-a7a6841e6a82 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d8d479cd-df88-4583-bf78-b5296050e065 req-49e6e580-1219-43aa-ac6c-a7a6841e6a82 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d8d479cd-df88-4583-bf78-b5296050e065 req-49e6e580-1219-43aa-ac6c-a7a6841e6a82 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d8d479cd-df88-4583-bf78-b5296050e065 req-49e6e580-1219-43aa-ac6c-a7a6841e6a82 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-d8d479cd-df88-4583-bf78-b5296050e065 req-49e6e580-1219-43aa-ac6c-a7a6841e6a82 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-unplugged-bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-d8d479cd-df88-4583-bf78-b5296050e065 req-49e6e580-1219-43aa-ac6c-a7a6841e6a82 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-bdd056c9-17af-4dfa-bf6b-a892b20bd869 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-5da50ce4-4ef0-4cb3-9971-44ee3e05f519 req-60f481a6-1af8-4423-b7d4-7182b356c5de service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5da50ce4-4ef0-4cb3-9971-44ee3e05f519 req-60f481a6-1af8-4423-b7d4-7182b356c5de service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5da50ce4-4ef0-4cb3-9971-44ee3e05f519 req-60f481a6-1af8-4423-b7d4-7182b356c5de service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5da50ce4-4ef0-4cb3-9971-44ee3e05f519 req-60f481a6-1af8-4423-b7d4-7182b356c5de service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-5da50ce4-4ef0-4cb3-9971-44ee3e05f519 req-60f481a6-1af8-4423-b7d4-7182b356c5de service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-unplugged-9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-5da50ce4-4ef0-4cb3-9971-44ee3e05f519 req-60f481a6-1af8-4423-b7d4-7182b356c5de service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-9b783d7f-a2aa-459d-9602-3d30eb4ac08c for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Instance destroyed successfully.
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.objects.instance [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lazy-loading 'resources' on Instance uuid 279a0c9c-91a3-4c5b-8918-b1a9278b59ac {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:8c:3c,bridge_name='br-int',has_traffic_filtering=True,id=69dadb43-0aba-4637-a9ac-b7214b9f37b0,network=Network(3e829335-f525-476c-8a61-05620e158170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69dadb43-0a') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:8c:3c,bridge_name='br-int',has_traffic_filtering=True,id=69dadb43-0aba-4637-a9ac-b7214b9f37b0,network=Network(3e829335-f525-476c-8a61-05620e158170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69dadb43-0a') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69dadb43-0a, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: INFO os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:8c:3c,bridge_name='br-int',has_traffic_filtering=True,id=69dadb43-0aba-4637-a9ac-b7214b9f37b0,network=Network(3e829335-f525-476c-8a61-05620e158170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69dadb43-0a')
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6e:e6,bridge_name='br-int',has_traffic_filtering=True,id=26243f2d-fe21-428b-b9bf-a1358aa60158,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26243f2d-fe') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6e:e6,bridge_name='br-int',has_traffic_filtering=True,id=26243f2d-fe21-428b-b9bf-a1358aa60158,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26243f2d-fe') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26243f2d-fe, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: INFO os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6e:e6,bridge_name='br-int',has_traffic_filtering=True,id=26243f2d-fe21-428b-b9bf-a1358aa60158,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26243f2d-fe')
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=d7aef91f-c547-400d-abf5-6da4ab08a52f,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7aef91f-c5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=d7aef91f-c547-400d-abf5-6da4ab08a52f,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7aef91f-c5') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7aef91f-c5, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:15 user nova-compute[72818]: INFO os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=d7aef91f-c547-400d-abf5-6da4ab08a52f,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7aef91f-c5')
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:e8:12,bridge_name='br-int',has_traffic_filtering=True,id=bdd056c9-17af-4dfa-bf6b-a892b20bd869,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd056c9-17') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:e8:12,bridge_name='br-int',has_traffic_filtering=True,id=bdd056c9-17af-4dfa-bf6b-a892b20bd869,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd056c9-17') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdd056c9-17, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:15 user nova-compute[72818]: INFO os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:e8:12,bridge_name='br-int',has_traffic_filtering=True,id=bdd056c9-17af-4dfa-bf6b-a892b20bd869,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd056c9-17')
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:12:24,bridge_name='br-int',has_traffic_filtering=True,id=b45072f7-8d1e-4d77-875e-92172d9ad7d7,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45072f7-8d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:12:24,bridge_name='br-int',has_traffic_filtering=True,id=b45072f7-8d1e-4d77-875e-92172d9ad7d7,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45072f7-8d') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb45072f7-8d, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:15 user nova-compute[72818]: INFO os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:12:24,bridge_name='br-int',has_traffic_filtering=True,id=b45072f7-8d1e-4d77-875e-92172d9ad7d7,network=Network(927b0f7f-5377-4288-b471-ad73b8957f61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45072f7-8d')
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "address": "fa:16:3e:9b:c5:5d", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b783d7f-a2", "ovs_interfaceid": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "address": "fa:16:3e:9b:c5:5d", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b783d7f-a2", "ovs_interfaceid": "9b783d7f-a2aa-459d-9602-3d30eb4ac08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c5:5d,bridge_name='br-int',has_traffic_filtering=True,id=9b783d7f-a2aa-459d-9602-3d30eb4ac08c,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b783d7f-a2') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c5:5d,bridge_name='br-int',has_traffic_filtering=True,id=9b783d7f-a2aa-459d-9602-3d30eb4ac08c,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b783d7f-a2') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b783d7f-a2, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:15 user nova-compute[72818]: INFO os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c5:5d,bridge_name='br-int',has_traffic_filtering=True,id=9b783d7f-a2aa-459d-9602-3d30eb4ac08c,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b783d7f-a2')
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T21:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-934677209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-934677209',id=9,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+A/mYoboUSec36LyYMRt0qNA28P9Dx1/7PGEPCPaTLCt6zZEnQNZ9P1kKGbYyFQKplXXSLT64bDlpsgBiVTvKYdBLqdnn1u01i11yfhK3gy4qBNTuxvWeb5TCV+bNg==',key_name='tempest-keypair-1102893518',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8397a213614aa8ae114a39b2669d35',ramdisk_id='',reservation_id='r-0k6p9bmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1320279136',owner_user_name='tempest-TaggedBootDevicesTest_v242-1320279136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52192f72fa646ec8422d0e623f9922d',uuid=279a0c9c-91a3-4c5b-8918-b1a9278b59ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converting VIF {"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:36:75,bridge_name='br-int',has_traffic_filtering=True,id=7851b371-1f54-4adc-af39-dd6e60f98e9d,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7851b371-1f') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:36:75,bridge_name='br-int',has_traffic_filtering=True,id=7851b371-1f54-4adc-af39-dd6e60f98e9d,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7851b371-1f') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7851b371-1f, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:15 user nova-compute[72818]: INFO os_vif [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:36:75,bridge_name='br-int',has_traffic_filtering=True,id=7851b371-1f54-4adc-af39-dd6e60f98e9d,network=Network(6fdedfe0-2db5-4cc3-9294-4e03ddec1866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7851b371-1f')
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBLqHMxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:19:15 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[118e634f-879b-49ce-a5b4-63cb44f9bf28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98aa5db-804e-4ddf-aa6d-714dda34de18]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fa3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a'): ({'sdg'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Removing single pathed devices sdg {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9a2e00-8952-4f86-ac85-956b4c8646be]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[219e97ab-dfb3-46b5-9c28-19c3bdce4a07]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Flushing IO for device /dev/sdg {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec22d95-ed6c-44b3-9cfa-c6c9afbab530]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eb1946-fcb4-4adb-90c1-bdae53da0212]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] SCSI volumes sdg have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0648eafa-6e9e-4aee-8fbd-a45c1e9b8aa5]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:15 user nova-compute[72818]: INFO nova.compute.manager [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Detaching volume e0f5f321-d2d0-4c74-9b9c-ca06667cebb0
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e83748-6744-4689-b8e8-12918d715a24]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a, portal: 172.16.0.220,3260]
Aug 17 21:19:15 user nova-compute[72818]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a, portal: 172.16.0.220,3260] successful.
Aug 17 21:19:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5515ad1e-fe92-498d-95f4-3f7bf824d51a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d525770c-40ce-4e46-8795-528b66591fed]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] <== disconnect_volume: return (333ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGaOEduS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:19:15 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: INFO nova.virt.block_device [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Attempting to driver detach volume e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 from mountpoint /dev/vdb
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[31372195-71aa-4733-9128-61368d9ea685]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Attempting to detach device vdb from instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:19:15 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:19:15 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:19:15 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:19:15 user nova-compute[72818]:   <serial>e0f5f321-d2d0-4c74-9b9c-ca06667cebb0</serial>
Aug 17 21:19:15 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:19:15 user nova-compute[72818]: </disk>
Aug 17 21:19:15 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:19:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Successfully detached device vdb from instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 from the persistent domain config.
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:19:15 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:19:15 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:19:15 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:19:15 user nova-compute[72818]:   <serial>e0f5f321-d2d0-4c74-9b9c-ca06667cebb0</serial>
Aug 17 21:19:15 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:19:15 user nova-compute[72818]: </disk>
Aug 17 21:19:15 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0152a1-61bd-4867-822a-2d3bbe1a8684]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b (non-flash)
Aug 17 21:19:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fb6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b'): ({'sdf'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Removing single pathed devices sdf {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e919303-46a0-4441-bba8-c6ee1b8557d9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1fdae2-c6eb-4606-97ae-aad011b02a76]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Flushing IO for device /dev/sdf {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2201b8c1-2ed8-4957-86dc-a96382f82a76]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ba2a65-8baa-4b62-98b3-18d00e82d76c]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] SCSI volumes sdf have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd8845-8a6d-44d9-a578-b882d04c5766]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:15 user nova-compute[72818]: WARNING nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-69dadb43-0aba-4637-a9ac-b7214b9f37b0 for instance with vm_state active and task_state deleting.
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-26243f2d-fe21-428b-b9bf-a1358aa60158 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-unplugged-26243f2d-fe21-428b-b9bf-a1358aa60158 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-26243f2d-fe21-428b-b9bf-a1358aa60158 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-26243f2d-fe21-428b-b9bf-a1358aa60158 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-26243f2d-fe21-428b-b9bf-a1358aa60158 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:15 user nova-compute[72818]: WARNING nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-26243f2d-fe21-428b-b9bf-a1358aa60158 for instance with vm_state active and task_state deleting.
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-d7aef91f-c547-400d-abf5-6da4ab08a52f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-unplugged-d7aef91f-c547-400d-abf5-6da4ab08a52f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-d7aef91f-c547-400d-abf5-6da4ab08a52f for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-d7aef91f-c547-400d-abf5-6da4ab08a52f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-d7aef91f-c547-400d-abf5-6da4ab08a52f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:15 user nova-compute[72818]: WARNING nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-d7aef91f-c547-400d-abf5-6da4ab08a52f for instance with vm_state active and task_state deleting.
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-unplugged-b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-b45072f7-8d1e-4d77-875e-92172d9ad7d7 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:15 user nova-compute[72818]: WARNING nova.compute.manager [req-8cbd2e44-a89f-4f7c-827f-3e69edf96aa3 req-d0e4945c-573b-4654-8782-59e3b3fe5ea5 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-b45072f7-8d1e-4d77-875e-92172d9ad7d7 for instance with vm_state active and task_state deleting.
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c705157c-c8b5-4896-be4f-acd68ee87c24]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b, portal: 172.16.0.220,3260]
Aug 17 21:19:15 user nova-compute[72818]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b, portal: 172.16.0.220,3260] successful.
Aug 17 21:19:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0c56f6-aaef-4f42-8704-f37701694b3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaf8151-917c-49ae-9338-7e5d4eb529cb]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] <== disconnect_volume: return (326ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OldqEaRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:19:15 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-729b4f0c-9004-4849-b0bc-75ec9638ace3 req-f35f5c58-0e2a-46f1-bb46-313cc8659669 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-729b4f0c-9004-4849-b0bc-75ec9638ace3 req-f35f5c58-0e2a-46f1-bb46-313cc8659669 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-729b4f0c-9004-4849-b0bc-75ec9638ace3 req-f35f5c58-0e2a-46f1-bb46-313cc8659669 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-729b4f0c-9004-4849-b0bc-75ec9638ace3 req-f35f5c58-0e2a-46f1-bb46-313cc8659669 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-729b4f0c-9004-4849-b0bc-75ec9638ace3 req-f35f5c58-0e2a-46f1-bb46-313cc8659669 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:15 user nova-compute[72818]: WARNING nova.compute.manager [req-729b4f0c-9004-4849-b0bc-75ec9638ace3 req-f35f5c58-0e2a-46f1-bb46-313cc8659669 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-bdd056c9-17af-4dfa-bf6b-a892b20bd869 for instance with vm_state active and task_state deleting.
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf714ae-c599-4f05-b937-85727a30133d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ff9ad7-5724-4e33-9047-a675ccf92677]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)
Aug 17 21:19:15 user nova-compute[72818]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a (non-flash)
Aug 17 21:19:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f2860d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a'): ({'sdd'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Removing single pathed devices sdd {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6872a23e-2eb8-4533-a4db-81f70afd000e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f585512-e0fb-4931-b6a8-bed7f98624e5]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Flushing IO for device /dev/sdd {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dea839-11c0-4409-b875-bd33e530dc72]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692307156.0384169, 48b00603-33ea-4eaa-b445-934ba1ab88f4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:19:16 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Successfully detached device vdb from instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 from the live domain config.
Aug 17 21:19:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JYDALhlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:19:16 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4c94e8-d58f-41e2-b91b-24018a87e09c]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[508c89d1-d20e-4c84-8651-3842c3a30b94]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdc796b-8c04-48ba-b092-4620abe2db97]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a, portal: 172.16.0.220,3260]
Aug 17 21:19:16 user nova-compute[72818]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a, portal: 172.16.0.220,3260] successful.
Aug 17 21:19:16 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f0d88-dc09-4a49-8c8c-bde11b1a157a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[912de211-daa3-41d0-b1a2-a445af707870]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] <== disconnect_volume: return (310ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:19:16 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Deleting instance files /opt/stack/data/nova/instances/279a0c9c-91a3-4c5b-8918-b1a9278b59ac_del
Aug 17 21:19:16 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Deletion of /opt/stack/data/nova/instances/279a0c9c-91a3-4c5b-8918-b1a9278b59ac_del complete
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.147s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[984dbff5-6ebe-47c6-8994-f37de319caa0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7055aa-e1a6-4d2a-a605-57dc4b8824a4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:16 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:16 user nova-compute[72818]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)
Aug 17 21:19:16 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:16 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:16 user nova-compute[72818]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 (non-flash)
Aug 17 21:19:16 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fa2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[78953d65-468d-4496-8954-ebe78a07a37a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: INFO nova.compute.manager [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Took 3.27 seconds to destroy the instance on the hypervisor.
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-c5b1e66b-5fe6-4ce1-9c84-434911ae6a1c req-f7f95301-de2f-4134-90ae-59a65aa516b4 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c5b1e66b-5fe6-4ce1-9c84-434911ae6a1c req-f7f95301-de2f-4134-90ae-59a65aa516b4 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c5b1e66b-5fe6-4ce1-9c84-434911ae6a1c req-f7f95301-de2f-4134-90ae-59a65aa516b4 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c5b1e66b-5fe6-4ce1-9c84-434911ae6a1c req-f7f95301-de2f-4134-90ae-59a65aa516b4 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-c5b1e66b-5fe6-4ce1-9c84-434911ae6a1c req-f7f95301-de2f-4134-90ae-59a65aa516b4 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:16 user nova-compute[72818]: WARNING nova.compute.manager [req-c5b1e66b-5fe6-4ce1-9c84-434911ae6a1c req-f7f95301-de2f-4134-90ae-59a65aa516b4 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-9b783d7f-a2aa-459d-9602-3d30eb4ac08c for instance with vm_state active and task_state deleting.
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37da73a-b2f0-4f58-b702-40ef50e53c3e]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f902ae01-410f-4f58-a6f3-64b162802a6f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b09b03-c74b-48cc-86bc-20f3924480ec]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[986a6a11-dba0-4f20-b3b7-0f6a61594a46]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e613fd-9a84-4ef1-b0ce-c8e4cb08990d]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0, portal: 172.16.0.220,3260]
Aug 17 21:19:16 user nova-compute[72818]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0, portal: 172.16.0.220,3260] successful.
Aug 17 21:19:16 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f5f321-d2d0-4c74-9b9c-ca06667cebb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cbaf0f-8b3e-4224-89c2-a7a35779084d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] <== disconnect_volume: return (441ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:19:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lazy-loading 'flavor' on Instance uuid 48b00603-33ea-4eaa-b445-934ba1ab88f4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d9ede8d3-ab03-44a1-aeb8-b7ef9e3a832c tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.834s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307142.5502336, a4618087-b551-4cc4-b50e-5276bb8395cd => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:19:17 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] VM Stopped (Lifecycle Event)
Aug 17 21:19:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-438fba83-972f-4e85-bfd4-1178b23ad994 None None] [instance: a4618087-b551-4cc4-b50e-5276bb8395cd] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-6726ad9d-a85f-4c1f-beba-60c2a9efa14c req-8844acfc-af21-40bb-8833-4f320c0c7c30 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6726ad9d-a85f-4c1f-beba-60c2a9efa14c req-8844acfc-af21-40bb-8833-4f320c0c7c30 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6726ad9d-a85f-4c1f-beba-60c2a9efa14c req-8844acfc-af21-40bb-8833-4f320c0c7c30 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6726ad9d-a85f-4c1f-beba-60c2a9efa14c req-8844acfc-af21-40bb-8833-4f320c0c7c30 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-6726ad9d-a85f-4c1f-beba-60c2a9efa14c req-8844acfc-af21-40bb-8833-4f320c0c7c30 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-unplugged-7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-6726ad9d-a85f-4c1f-beba-60c2a9efa14c req-8844acfc-af21-40bb-8833-4f320c0c7c30 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-unplugged-7851b371-1f54-4adc-af39-dd6e60f98e9d for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-6726ad9d-a85f-4c1f-beba-60c2a9efa14c req-8844acfc-af21-40bb-8833-4f320c0c7c30 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-plugged-7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6726ad9d-a85f-4c1f-beba-60c2a9efa14c req-8844acfc-af21-40bb-8833-4f320c0c7c30 service nova] Acquiring lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6726ad9d-a85f-4c1f-beba-60c2a9efa14c req-8844acfc-af21-40bb-8833-4f320c0c7c30 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6726ad9d-a85f-4c1f-beba-60c2a9efa14c req-8844acfc-af21-40bb-8833-4f320c0c7c30 service nova] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-6726ad9d-a85f-4c1f-beba-60c2a9efa14c req-8844acfc-af21-40bb-8833-4f320c0c7c30 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] No waiting events found dispatching network-vif-plugged-7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:17 user nova-compute[72818]: WARNING nova.compute.manager [req-6726ad9d-a85f-4c1f-beba-60c2a9efa14c req-8844acfc-af21-40bb-8833-4f320c0c7c30 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received unexpected event network-vif-plugged-7851b371-1f54-4adc-af39-dd6e60f98e9d for instance with vm_state active and task_state deleting.
Aug 17 21:19:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-7f1ceca8-ee17-4456-8960-20e4af839c9e req-11b36267-4905-4024-a849-2ada4c0b4d1e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-deleted-9b783d7f-a2aa-459d-9602-3d30eb4ac08c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:19 user nova-compute[72818]: INFO nova.compute.manager [req-7f1ceca8-ee17-4456-8960-20e4af839c9e req-11b36267-4905-4024-a849-2ada4c0b4d1e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Neutron deleted interface 9b783d7f-a2aa-459d-9602-3d30eb4ac08c; detaching it from the instance and deleting it from the info cache
Aug 17 21:19:19 user nova-compute[72818]: DEBUG nova.network.neutron [req-7f1ceca8-ee17-4456-8960-20e4af839c9e req-11b36267-4905-4024-a849-2ada4c0b4d1e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [{"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "address": "fa:16:3e:5a:12:24", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45072f7-8d", "ovs_interfaceid": "b45072f7-8d1e-4d77-875e-92172d9ad7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-7f1ceca8-ee17-4456-8960-20e4af839c9e req-11b36267-4905-4024-a849-2ada4c0b4d1e service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Detach interface failed, port_id=9b783d7f-a2aa-459d-9602-3d30eb4ac08c, reason: Instance 279a0c9c-91a3-4c5b-8918-b1a9278b59ac could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:19:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-dd6aaa18-eed4-4a50-9b8b-c7e6a42be1a4 req-908a2186-eeec-44b2-8def-9a7fe7b195db service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-deleted-b45072f7-8d1e-4d77-875e-92172d9ad7d7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:21 user nova-compute[72818]: INFO nova.compute.manager [req-dd6aaa18-eed4-4a50-9b8b-c7e6a42be1a4 req-908a2186-eeec-44b2-8def-9a7fe7b195db service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Neutron deleted interface b45072f7-8d1e-4d77-875e-92172d9ad7d7; detaching it from the instance and deleting it from the info cache
Aug 17 21:19:21 user nova-compute[72818]: DEBUG nova.network.neutron [req-dd6aaa18-eed4-4a50-9b8b-c7e6a42be1a4 req-908a2186-eeec-44b2-8def-9a7fe7b195db service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [{"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "address": "fa:16:3e:13:e8:12", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd056c9-17", "ovs_interfaceid": "bdd056c9-17af-4dfa-bf6b-a892b20bd869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-dd6aaa18-eed4-4a50-9b8b-c7e6a42be1a4 req-908a2186-eeec-44b2-8def-9a7fe7b195db service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Detach interface failed, port_id=b45072f7-8d1e-4d77-875e-92172d9ad7d7, reason: Instance 279a0c9c-91a3-4c5b-8918-b1a9278b59ac could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:19:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-dd6aaa18-eed4-4a50-9b8b-c7e6a42be1a4 req-908a2186-eeec-44b2-8def-9a7fe7b195db service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-deleted-bdd056c9-17af-4dfa-bf6b-a892b20bd869 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:21 user nova-compute[72818]: INFO nova.compute.manager [req-dd6aaa18-eed4-4a50-9b8b-c7e6a42be1a4 req-908a2186-eeec-44b2-8def-9a7fe7b195db service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Neutron deleted interface bdd056c9-17af-4dfa-bf6b-a892b20bd869; detaching it from the instance and deleting it from the info cache
Aug 17 21:19:21 user nova-compute[72818]: DEBUG nova.network.neutron [req-dd6aaa18-eed4-4a50-9b8b-c7e6a42be1a4 req-908a2186-eeec-44b2-8def-9a7fe7b195db service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [{"id": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "address": "fa:16:3e:4c:8c:3c", "network": {"id": "3e829335-f525-476c-8a61-05620e158170", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-901325690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69dadb43-0a", "ovs_interfaceid": "69dadb43-0aba-4637-a9ac-b7214b9f37b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26243f2d-fe21-428b-b9bf-a1358aa60158", "address": "fa:16:3e:d2:6e:e6", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26243f2d-fe", "ovs_interfaceid": "26243f2d-fe21-428b-b9bf-a1358aa60158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "address": "fa:16:3e:cd:91:ee", "network": {"id": "927b0f7f-5377-4288-b471-ad73b8957f61", "bridge": "br-int", "label": "tempest-device-tagging-net1-286644337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aef91f-c5", "ovs_interfaceid": "d7aef91f-c547-400d-abf5-6da4ab08a52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "address": "fa:16:3e:22:36:75", "network": {"id": "6fdedfe0-2db5-4cc3-9294-4e03ddec1866", "bridge": "br-int", "label": "tempest-device-tagging-net2-1613741330", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7c8397a213614aa8ae114a39b2669d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7851b371-1f", "ovs_interfaceid": "7851b371-1f54-4adc-af39-dd6e60f98e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-dd6aaa18-eed4-4a50-9b8b-c7e6a42be1a4 req-908a2186-eeec-44b2-8def-9a7fe7b195db service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Detach interface failed, port_id=bdd056c9-17af-4dfa-bf6b-a892b20bd869, reason: Instance 279a0c9c-91a3-4c5b-8918-b1a9278b59ac could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:19:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:19:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:19:22 user nova-compute[72818]: INFO nova.compute.claims [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Claim successful on node user
Aug 17 21:19:22 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:23 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Took 6.70 seconds to deallocate network for instance.
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.network.neutron [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:19:23 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.policy [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ffa40080d9842b1a4f6a3e041b5d123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6bdddb43364e86b302c9c2e273fd44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:19:23 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Creating image(s)
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "/opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "/opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.229s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-08320097-d591-4316-9e4f-2ee24424fd2e req-aea63023-feab-4bba-81b9-a9ae11f46525 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-deleted-7851b371-1f54-4adc-af39-dd6e60f98e9d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-08320097-d591-4316-9e4f-2ee24424fd2e req-aea63023-feab-4bba-81b9-a9ae11f46525 service nova] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Received event network-vif-deleted-69dadb43-0aba-4637-a9ac-b7214b9f37b0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:19:23 user nova-compute[72818]: INFO nova.compute.claims [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Claim successful on node user
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.243s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk 1073741824" returned: 0 in 0.065s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Successfully created port: 73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Cannot resize image /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.objects.instance [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'migration_context' on Instance uuid 4b43de5d-62c1-4368-8a77-59899ae0b16d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Ensure instance console log exists: /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:19:24 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.policy [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ffa40080d9842b1a4f6a3e041b5d123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6bdddb43364e86b302c9c2e273fd44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:19:24 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Creating image(s)
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "/opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "/opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "/opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.200s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk 1073741824" returned: 0 in 0.057s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Successfully updated port: 73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.216s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquired lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Successfully created port: c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Cannot resize image /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'migration_context' on Instance uuid 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Ensure instance console log exists: /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG nova.compute.manager [req-52c57187-18ff-4f0b-871c-72828a63183c req-db72eef8-e144-4190-95c4-befa1d044ebb service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-changed-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG nova.compute.manager [req-52c57187-18ff-4f0b-871c-72828a63183c req-db72eef8-e144-4190-95c4-befa1d044ebb service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Refreshing instance network info cache due to event network-changed-73bea181-5987-4935-af5c-9f87b135d933. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-52c57187-18ff-4f0b-871c-72828a63183c req-db72eef8-e144-4190-95c4-befa1d044ebb service nova] Acquiring lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:19:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Updating instance_info_cache with network_info: [{"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:26 user nova-compute[72818]: INFO nova.compute.manager [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Took 3.00 seconds to detach 3 volumes for instance.
Aug 17 21:19:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Releasing lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.compute.manager [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Instance network_info: |[{"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-52c57187-18ff-4f0b-871c-72828a63183c req-db72eef8-e144-4190-95c4-befa1d044ebb service nova] Acquired lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-52c57187-18ff-4f0b-871c-72828a63183c req-db72eef8-e144-4190-95c4-befa1d044ebb service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Refreshing network info cache for port 73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Start _get_guest_xml network_info=[{"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:19:26 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:19:26 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-688622221',display_name='tempest-ServerRescueNegativeTestJSON-server-688622221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-688622221',id=15,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f6bdddb43364e86b302c9c2e273fd44',ramdisk_id='',reservation_id='r-ek70jhb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-713886303',owner_user_name='tempest-ServerRescueNegativeTestJSON-713886303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:19:23Z,user_data=None,user_id='8ffa40080d9842b1a4f6a3e041b5d123',uuid=4b43de5d-62c1-4368-8a77-59899ae0b16d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converting VIF {"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:61:a7,bridge_name='br-int',has_traffic_filtering=True,id=73bea181-5987-4935-af5c-9f87b135d933,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bea181-59') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.objects.instance [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b43de5d-62c1-4368-8a77-59899ae0b16d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:19:26 user nova-compute[72818]:   <uuid>4b43de5d-62c1-4368-8a77-59899ae0b16d</uuid>
Aug 17 21:19:26 user nova-compute[72818]:   <name>instance-0000000f</name>
Aug 17 21:19:26 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:19:26 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:19:26 user nova-compute[72818]:   <metadata>
Aug 17 21:19:26 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:19:26 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:19:26 user nova-compute[72818]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-688622221</nova:name>
Aug 17 21:19:26 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:19:26</nova:creationTime>
Aug 17 21:19:26 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:19:26 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:19:26 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:19:26 user nova-compute[72818]:       <nova:owner>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:user uuid="8ffa40080d9842b1a4f6a3e041b5d123">tempest-ServerRescueNegativeTestJSON-713886303-project-member</nova:user>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:project uuid="7f6bdddb43364e86b302c9c2e273fd44">tempest-ServerRescueNegativeTestJSON-713886303</nova:project>
Aug 17 21:19:26 user nova-compute[72818]:       </nova:owner>
Aug 17 21:19:26 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:19:26 user nova-compute[72818]:       <nova:ports>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:port uuid="73bea181-5987-4935-af5c-9f87b135d933">
Aug 17 21:19:26 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 21:19:26 user nova-compute[72818]:         </nova:port>
Aug 17 21:19:26 user nova-compute[72818]:       </nova:ports>
Aug 17 21:19:26 user nova-compute[72818]:     </nova:instance>
Aug 17 21:19:26 user nova-compute[72818]:   </metadata>
Aug 17 21:19:26 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:19:26 user nova-compute[72818]:     <system>
Aug 17 21:19:26 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:19:26 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:19:26 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:19:26 user nova-compute[72818]:       <entry name="serial">4b43de5d-62c1-4368-8a77-59899ae0b16d</entry>
Aug 17 21:19:26 user nova-compute[72818]:       <entry name="uuid">4b43de5d-62c1-4368-8a77-59899ae0b16d</entry>
Aug 17 21:19:26 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:19:26 user nova-compute[72818]:     </system>
Aug 17 21:19:26 user nova-compute[72818]:   </sysinfo>
Aug 17 21:19:26 user nova-compute[72818]:   <os>
Aug 17 21:19:26 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:19:26 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:19:26 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:19:26 user nova-compute[72818]:   </os>
Aug 17 21:19:26 user nova-compute[72818]:   <features>
Aug 17 21:19:26 user nova-compute[72818]:     <acpi/>
Aug 17 21:19:26 user nova-compute[72818]:     <apic/>
Aug 17 21:19:26 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:19:26 user nova-compute[72818]:   </features>
Aug 17 21:19:26 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:19:26 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:19:26 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:19:26 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:19:26 user nova-compute[72818]:   </clock>
Aug 17 21:19:26 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:19:26 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:19:26 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:19:26 user nova-compute[72818]:   </cpu>
Aug 17 21:19:26 user nova-compute[72818]:   <devices>
Aug 17 21:19:26 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:19:26 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:19:26 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk"/>
Aug 17 21:19:26 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:19:26 user nova-compute[72818]:     </disk>
Aug 17 21:19:26 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:19:26 user nova-compute[72818]:       <mac address="fa:16:3e:de:61:a7"/>
Aug 17 21:19:26 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:19:26 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:19:26 user nova-compute[72818]:       <target dev="tap73bea181-59"/>
Aug 17 21:19:26 user nova-compute[72818]:     </interface>
Aug 17 21:19:26 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:19:26 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/console.log" append="off"/>
Aug 17 21:19:26 user nova-compute[72818]:     </serial>
Aug 17 21:19:26 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:19:26 user nova-compute[72818]:     <video>
Aug 17 21:19:26 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:19:26 user nova-compute[72818]:     </video>
Aug 17 21:19:26 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:19:26 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:19:26 user nova-compute[72818]:     </rng>
Aug 17 21:19:26 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:19:26 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:19:26 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:19:26 user nova-compute[72818]:     </memballoon>
Aug 17 21:19:26 user nova-compute[72818]:   </devices>
Aug 17 21:19:26 user nova-compute[72818]: </domain>
Aug 17 21:19:26 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-688622221',display_name='tempest-ServerRescueNegativeTestJSON-server-688622221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-688622221',id=15,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f6bdddb43364e86b302c9c2e273fd44',ramdisk_id='',reservation_id='r-ek70jhb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-713886303',owner_user_name='tempest-ServerRescueNegativeTestJSON-713886303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:19:23Z,user_data=None,user_id='8ffa40080d9842b1a4f6a3e041b5d123',uuid=4b43de5d-62c1-4368-8a77-59899ae0b16d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converting VIF {"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:61:a7,bridge_name='br-int',has_traffic_filtering=True,id=73bea181-5987-4935-af5c-9f87b135d933,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bea181-59') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG os_vif [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:61:a7,bridge_name='br-int',has_traffic_filtering=True,id=73bea181-5987-4935-af5c-9f87b135d933,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bea181-59') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73bea181-59, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73bea181-59, col_values=(('external_ids', {'iface-id': '73bea181-5987-4935-af5c-9f87b135d933', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:61:a7', 'vm-uuid': '4b43de5d-62c1-4368-8a77-59899ae0b16d'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:26 user nova-compute[72818]: INFO os_vif [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:61:a7,bridge_name='br-int',has_traffic_filtering=True,id=73bea181-5987-4935-af5c-9f87b135d933,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bea181-59')
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No VIF found with MAC fa:16:3e:de:61:a7, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Successfully updated port: c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquired lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-4765da11-b4fd-4bc8-9541-2564a01beac8 req-5af3cbf1-2b58-4eeb-9ae4-f0c71be238d2 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-changed-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-4765da11-b4fd-4bc8-9541-2564a01beac8 req-5af3cbf1-2b58-4eeb-9ae4-f0c71be238d2 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Refreshing instance network info cache due to event network-changed-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4765da11-b4fd-4bc8-9541-2564a01beac8 req-5af3cbf1-2b58-4eeb-9ae4-f0c71be238d2 service nova] Acquiring lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:26 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Deleted allocations for instance 279a0c9c-91a3-4c5b-8918-b1a9278b59ac
Aug 17 21:19:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a61521ad-3af9-4727-b2b7-767390ff3c29 tempest-TaggedBootDevicesTest_v242-1320279136 tempest-TaggedBootDevicesTest_v242-1320279136-project-member] Lock "279a0c9c-91a3-4c5b-8918-b1a9278b59ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.677s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Updating instance_info_cache with network_info: [{"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Releasing lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Instance network_info: |[{"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4765da11-b4fd-4bc8-9541-2564a01beac8 req-5af3cbf1-2b58-4eeb-9ae4-f0c71be238d2 service nova] Acquired lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-4765da11-b4fd-4bc8-9541-2564a01beac8 req-5af3cbf1-2b58-4eeb-9ae4-f0c71be238d2 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Refreshing network info cache for port c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Start _get_guest_xml network_info=[{"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:19:26 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:19:26 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-141122876',display_name='tempest-ServerRescueNegativeTestJSON-server-141122876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-141122876',id=16,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f6bdddb43364e86b302c9c2e273fd44',ramdisk_id='',reservation_id='r-maezm2id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-713886303',owner_user_name='tempest-ServerRescueNegativeTestJSON-713886303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:19:25Z,user_data=None,user_id='8ffa40080d9842b1a4f6a3e041b5d123',uuid=94abd430-6fc8-4c31-9dc8-c44df16ed4a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converting VIF {"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:bf:34,bridge_name='br-int',has_traffic_filtering=True,id=c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37ec1f4-f3') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'pci_devices' on Instance uuid 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:19:26 user nova-compute[72818]:   <uuid>94abd430-6fc8-4c31-9dc8-c44df16ed4a3</uuid>
Aug 17 21:19:26 user nova-compute[72818]:   <name>instance-00000010</name>
Aug 17 21:19:26 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:19:26 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:19:26 user nova-compute[72818]:   <metadata>
Aug 17 21:19:26 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:19:26 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:19:26 user nova-compute[72818]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-141122876</nova:name>
Aug 17 21:19:26 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:19:26</nova:creationTime>
Aug 17 21:19:26 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:19:26 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:19:26 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:19:26 user nova-compute[72818]:       <nova:owner>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:user uuid="8ffa40080d9842b1a4f6a3e041b5d123">tempest-ServerRescueNegativeTestJSON-713886303-project-member</nova:user>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:project uuid="7f6bdddb43364e86b302c9c2e273fd44">tempest-ServerRescueNegativeTestJSON-713886303</nova:project>
Aug 17 21:19:26 user nova-compute[72818]:       </nova:owner>
Aug 17 21:19:26 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:19:26 user nova-compute[72818]:       <nova:ports>
Aug 17 21:19:26 user nova-compute[72818]:         <nova:port uuid="c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5">
Aug 17 21:19:26 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 21:19:26 user nova-compute[72818]:         </nova:port>
Aug 17 21:19:26 user nova-compute[72818]:       </nova:ports>
Aug 17 21:19:26 user nova-compute[72818]:     </nova:instance>
Aug 17 21:19:26 user nova-compute[72818]:   </metadata>
Aug 17 21:19:26 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:19:26 user nova-compute[72818]:     <system>
Aug 17 21:19:26 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:19:26 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:19:26 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:19:26 user nova-compute[72818]:       <entry name="serial">94abd430-6fc8-4c31-9dc8-c44df16ed4a3</entry>
Aug 17 21:19:26 user nova-compute[72818]:       <entry name="uuid">94abd430-6fc8-4c31-9dc8-c44df16ed4a3</entry>
Aug 17 21:19:26 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:19:26 user nova-compute[72818]:     </system>
Aug 17 21:19:26 user nova-compute[72818]:   </sysinfo>
Aug 17 21:19:26 user nova-compute[72818]:   <os>
Aug 17 21:19:26 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:19:26 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:19:26 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:19:26 user nova-compute[72818]:   </os>
Aug 17 21:19:26 user nova-compute[72818]:   <features>
Aug 17 21:19:26 user nova-compute[72818]:     <acpi/>
Aug 17 21:19:26 user nova-compute[72818]:     <apic/>
Aug 17 21:19:26 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:19:26 user nova-compute[72818]:   </features>
Aug 17 21:19:26 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:19:26 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:19:26 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:19:26 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:19:26 user nova-compute[72818]:   </clock>
Aug 17 21:19:26 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:19:26 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:19:26 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:19:26 user nova-compute[72818]:   </cpu>
Aug 17 21:19:26 user nova-compute[72818]:   <devices>
Aug 17 21:19:26 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:19:26 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:19:26 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk"/>
Aug 17 21:19:26 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:19:26 user nova-compute[72818]:     </disk>
Aug 17 21:19:26 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:19:26 user nova-compute[72818]:       <mac address="fa:16:3e:ed:bf:34"/>
Aug 17 21:19:26 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:19:26 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:19:26 user nova-compute[72818]:       <target dev="tapc37ec1f4-f3"/>
Aug 17 21:19:26 user nova-compute[72818]:     </interface>
Aug 17 21:19:26 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:19:26 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/console.log" append="off"/>
Aug 17 21:19:26 user nova-compute[72818]:     </serial>
Aug 17 21:19:26 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:19:26 user nova-compute[72818]:     <video>
Aug 17 21:19:26 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:19:26 user nova-compute[72818]:     </video>
Aug 17 21:19:26 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:19:26 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:19:26 user nova-compute[72818]:     </rng>
Aug 17 21:19:26 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:19:26 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:19:26 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:19:26 user nova-compute[72818]:     </memballoon>
Aug 17 21:19:26 user nova-compute[72818]:   </devices>
Aug 17 21:19:26 user nova-compute[72818]: </domain>
Aug 17 21:19:26 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-141122876',display_name='tempest-ServerRescueNegativeTestJSON-server-141122876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-141122876',id=16,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f6bdddb43364e86b302c9c2e273fd44',ramdisk_id='',reservation_id='r-maezm2id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-713886303',owner_user_name='tempest-ServerRescueNegativeTestJSON-713886303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:19:25Z,user_data=None,user_id='8ffa40080d9842b1a4f6a3e041b5d123',uuid=94abd430-6fc8-4c31-9dc8-c44df16ed4a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converting VIF {"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:bf:34,bridge_name='br-int',has_traffic_filtering=True,id=c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37ec1f4-f3') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG os_vif [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:bf:34,bridge_name='br-int',has_traffic_filtering=True,id=c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37ec1f4-f3') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc37ec1f4-f3, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc37ec1f4-f3, col_values=(('external_ids', {'iface-id': 'c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:bf:34', 'vm-uuid': '94abd430-6fc8-4c31-9dc8-c44df16ed4a3'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:19:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:26 user nova-compute[72818]: INFO os_vif [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:bf:34,bridge_name='br-int',has_traffic_filtering=True,id=c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37ec1f4-f3')
Aug 17 21:19:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-52c57187-18ff-4f0b-871c-72828a63183c req-db72eef8-e144-4190-95c4-befa1d044ebb service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Updated VIF entry in instance network info cache for port 73bea181-5987-4935-af5c-9f87b135d933. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:19:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-52c57187-18ff-4f0b-871c-72828a63183c req-db72eef8-e144-4190-95c4-befa1d044ebb service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Updating instance_info_cache with network_info: [{"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:19:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No VIF found with MAC fa:16:3e:ed:bf:34, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:19:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-52c57187-18ff-4f0b-871c-72828a63183c req-db72eef8-e144-4190-95c4-befa1d044ebb service nova] Releasing lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:19:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-4765da11-b4fd-4bc8-9541-2564a01beac8 req-5af3cbf1-2b58-4eeb-9ae4-f0c71be238d2 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Updated VIF entry in instance network info cache for port c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:19:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-4765da11-b4fd-4bc8-9541-2564a01beac8 req-5af3cbf1-2b58-4eeb-9ae4-f0c71be238d2 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Updating instance_info_cache with network_info: [{"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4765da11-b4fd-4bc8-9541-2564a01beac8 req-5af3cbf1-2b58-4eeb-9ae4-f0c71be238d2 service nova] Releasing lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-79c556f3-83dd-4abc-bfd9-4b532908a4fb req-fafb9c5a-839a-4a2c-b252-2659a527c43c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-79c556f3-83dd-4abc-bfd9-4b532908a4fb req-fafb9c5a-839a-4a2c-b252-2659a527c43c service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-79c556f3-83dd-4abc-bfd9-4b532908a4fb req-fafb9c5a-839a-4a2c-b252-2659a527c43c service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-79c556f3-83dd-4abc-bfd9-4b532908a4fb req-fafb9c5a-839a-4a2c-b252-2659a527c43c service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-79c556f3-83dd-4abc-bfd9-4b532908a4fb req-fafb9c5a-839a-4a2c-b252-2659a527c43c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:28 user nova-compute[72818]: WARNING nova.compute.manager [req-79c556f3-83dd-4abc-bfd9-4b532908a4fb req-fafb9c5a-839a-4a2c-b252-2659a527c43c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state building and task_state spawning.
Aug 17 21:19:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:29 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307154.817671, 279a0c9c-91a3-4c5b-8918-b1a9278b59ac => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:19:29 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] VM Stopped (Lifecycle Event)
Aug 17 21:19:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-dcb0172e-ed9b-4094-8a5c-213aeb31eaf4 None None] [instance: 279a0c9c-91a3-4c5b-8918-b1a9278b59ac] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:30 user nova-compute[72818]: WARNING nova.compute.manager [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state building and task_state spawning.
Aug 17 21:19:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] No waiting events found dispatching network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:30 user nova-compute[72818]: WARNING nova.compute.manager [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received unexpected event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 for instance with vm_state building and task_state spawning.
Aug 17 21:19:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] No waiting events found dispatching network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:30 user nova-compute[72818]: WARNING nova.compute.manager [req-6c3adb52-36a6-498e-9967-dcc798125a34 req-b14793a3-7a03-47bc-9f81-9f5e72adf1a7 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received unexpected event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 for instance with vm_state building and task_state spawning.
Aug 17 21:19:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307171.3492584, 4b43de5d-62c1-4368-8a77-59899ae0b16d => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] VM Resumed (Lifecycle Event)
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Instance spawned successfully.
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307171.349799, 4b43de5d-62c1-4368-8a77-59899ae0b16d => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] VM Started (Lifecycle Event)
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.compute.manager [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Took 7.99 seconds to spawn the instance on the hypervisor.
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307171.4747775, 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] VM Resumed (Lifecycle Event)
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Instance spawned successfully.
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307171.475513, 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] VM Started (Lifecycle Event)
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.compute.manager [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Took 8.91 seconds to build instance.
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-98763a65-ce33-4751-affb-40632f9676f6 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.017s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.compute.manager [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Took 6.81 seconds to spawn the instance on the hypervisor.
Aug 17 21:19:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:31 user nova-compute[72818]: INFO nova.compute.manager [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Took 8.02 seconds to build instance.
Aug 17 21:19:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f0d57579-5020-4f1f-ad02-74a169323cd3 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.155s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:38 user nova-compute[72818]: INFO nova.compute.manager [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Rescuing
Aug 17 21:19:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:19:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquired lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:19:38 user nova-compute[72818]: DEBUG nova.network.neutron [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:19:38 user nova-compute[72818]: DEBUG nova.network.neutron [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Updating instance_info_cache with network_info: [{"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Releasing lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:19:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG nova.compute.manager [req-126bb742-b957-48eb-83ae-42275e5b4f8c req-9b21999a-3af6-4983-b495-82f280a460a0 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-unplugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-126bb742-b957-48eb-83ae-42275e5b4f8c req-9b21999a-3af6-4983-b495-82f280a460a0 service nova] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-126bb742-b957-48eb-83ae-42275e5b4f8c req-9b21999a-3af6-4983-b495-82f280a460a0 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-126bb742-b957-48eb-83ae-42275e5b4f8c req-9b21999a-3af6-4983-b495-82f280a460a0 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG nova.compute.manager [req-126bb742-b957-48eb-83ae-42275e5b4f8c req-9b21999a-3af6-4983-b495-82f280a460a0 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] No waiting events found dispatching network-vif-unplugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:39 user nova-compute[72818]: WARNING nova.compute.manager [req-126bb742-b957-48eb-83ae-42275e5b4f8c req-9b21999a-3af6-4983-b495-82f280a460a0 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received unexpected event network-vif-unplugged-67586c8a-e841-4778-891e-27307f1dbe67 for instance with vm_state active and task_state rescuing.
Aug 17 21:19:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:39 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Instance destroyed successfully.
Aug 17 21:19:39 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Attempting a stable device rescue
Aug 17 21:19:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72818) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Instance directory exists: not creating {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 21:19:39 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Creating image(s)
Aug 17 21:19:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "/opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "/opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "/opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'trusted_certs' on Instance uuid 827d6c12-deb5-4c05-ad6b-efba319783e9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "255aba1c3e2285638a5827135c6108ad591980bf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "255aba1c3e2285638a5827135c6108ad591980bf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf.part --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf.part --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:40 user nova-compute[72818]: DEBUG nova.virt.images [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] 6c31ac13-f234-4dfb-bf4c-f3b6b84ca935 was qcow2, converting to raw {{(pid=72818) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 21:19:40 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:19:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf.part /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf.converted {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf.part /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf.converted" returned: 0 in 0.412s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf.converted --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-3caaadc9-2447-45db-8e0c-bb4a3972eb77 req-7a6487f5-23f9-47b6-83f8-31ef28dfe9d9 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3caaadc9-2447-45db-8e0c-bb4a3972eb77 req-7a6487f5-23f9-47b6-83f8-31ef28dfe9d9 service nova] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3caaadc9-2447-45db-8e0c-bb4a3972eb77 req-7a6487f5-23f9-47b6-83f8-31ef28dfe9d9 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3caaadc9-2447-45db-8e0c-bb4a3972eb77 req-7a6487f5-23f9-47b6-83f8-31ef28dfe9d9 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-3caaadc9-2447-45db-8e0c-bb4a3972eb77 req-7a6487f5-23f9-47b6-83f8-31ef28dfe9d9 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] No waiting events found dispatching network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:41 user nova-compute[72818]: WARNING nova.compute.manager [req-3caaadc9-2447-45db-8e0c-bb4a3972eb77 req-7a6487f5-23f9-47b6-83f8-31ef28dfe9d9 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received unexpected event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 for instance with vm_state active and task_state rescuing.
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "255aba1c3e2285638a5827135c6108ad591980bf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.679s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "255aba1c3e2285638a5827135c6108ad591980bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "255aba1c3e2285638a5827135c6108ad591980bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf,backing_fmt=raw /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.rescue {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf,backing_fmt=raw /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.rescue" returned: 0 in 0.054s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "255aba1c3e2285638a5827135c6108ad591980bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'migration_context' on Instance uuid 827d6c12-deb5-4c05-ad6b-efba319783e9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Start _get_guest_xml network_info=[{"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "vif_mac": "fa:16:3e:5b:d5:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6c31ac13-f234-4dfb-bf4c-f3b6b84ca935', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '81779d39-d768-4c20-9bdd-59cfd0e7d59c', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrihzSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '827d6c12-deb5-4c05-ad6b-efba319783e9', 'attached_at': '', 'detached_at': '', 'volume_id': '5a9020bf-fade-4fea-a929-3910080fdf9a', 'serial': '5a9020bf-fade-4fea-a929-3910080fdf9a'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'resources' on Instance uuid 827d6c12-deb5-4c05-ad6b-efba319783e9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'numa_topology' on Instance uuid 827d6c12-deb5-4c05-ad6b-efba319783e9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:41 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:19:41 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'vcpu_model' on Instance uuid 827d6c12-deb5-4c05-ad6b-efba319783e9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrihzSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:19:41 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:41 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:41 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9a3570-b2f1-4833-a20a-dc3870b9e772]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QrihzSXc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 21:19:41 user nova-compute[72818]: node.name = iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a
Aug 17 21:19:41 user nova-compute[72818]: node.tpgt = -1
Aug 17 21:19:41 user nova-compute[72818]: node.startup = automatic
Aug 17 21:19:41 user nova-compute[72818]: node.leading_login = No
Aug 17 21:19:41 user nova-compute[72818]: iface.iscsi_ifacename = default
Aug 17 21:19:41 user nova-compute[72818]: iface.net_ifacename = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.ipaddress = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.prefix_len = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.hwaddress = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.transport_name = tcp
Aug 17 21:19:41 user nova-compute[72818]: iface.initiatorname = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.state = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.vlan_id = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.vlan_priority = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.vlan_state = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.iface_num = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.mtu = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.port = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.bootproto = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.subnet_mask = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.gateway = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.dhcp_alt_client_id = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.dhcp_dns = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.dhcp_learn_iqn = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.dhcp_vendor_id_state = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.dhcp_vendor_id = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.dhcp_slp_da = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.fragmentation = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.gratuitous_arp = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.incoming_forwarding = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.tos_state = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.tos = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.ttl = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.delayed_ack = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.tcp_nagle = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.tcp_wsf_state = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.tcp_wsf = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.tcp_timer_scale = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.tcp_timestamp = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.redirect = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.def_task_mgmt_timeout = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.header_digest = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.data_digest = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.immediate_data = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.initial_r2t = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.data_seq_inorder = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.data_pdu_inorder = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.erl = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.max_receive_data_len = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.first_burst_len = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.max_outstanding_r2t = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.max_burst_len = 0
Aug 17 21:19:41 user nova-compute[72818]: iface.chap_auth = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.bidi_chap = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.strict_login_compliance = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.discovery_auth = <empty>
Aug 17 21:19:41 user nova-compute[72818]: iface.discovery_logout = <empty>
Aug 17 21:19:41 user nova-compute[72818]: node.discovery_address = <empty>
Aug 17 21:19:41 user nova-compute[72818]: node.discovery_port = 0
Aug 17 21:19:41 user nova-compute[72818]: node.discovery_type = static
Aug 17 21:19:41 user nova-compute[72818]: node.session.initial_cmdsn = 0
Aug 17 21:19:41 user nova-compute[72818]: node.session.initial_login_retry_max = 8
Aug 17 21:19:41 user nova-compute[72818]: node.session.xmit_thread_priority = -20
Aug 17 21:19:41 user nova-compute[72818]: node.session.cmds_max = 128
Aug 17 21:19:41 user nova-compute[72818]: node.session.queue_depth = 32
Aug 17 21:19:41 user nova-compute[72818]: node.session.nr_sessions = 1
Aug 17 21:19:41 user nova-compute[72818]: node.session.auth.authmethod = CHAP
Aug 17 21:19:41 user nova-compute[72818]: node.session.auth.username = QrihzSXc
Aug 17 21:19:41 user nova-compute[72818]: node.session.auth.password = ***
Aug 17 21:19:41 user nova-compute[72818]: node.session.auth.username_in = <empty>
Aug 17 21:19:41 user nova-compute[72818]: node.session.auth.password_in = <empty>
Aug 17 21:19:41 user nova-compute[72818]: node.session.auth.chap_algs = MD5
Aug 17 21:19:41 user nova-compute[72818]: node.session.timeo.replacement_timeout = 120
Aug 17 21:19:41 user nova-compute[72818]: node.session.err_timeo.abort_timeout = 15
Aug 17 21:19:41 user nova-compute[72818]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 21:19:41 user nova-compute[72818]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 21:19:41 user nova-compute[72818]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 21:19:41 user nova-compute[72818]: node.session.iscsi.FastAbort = Yes
Aug 17 21:19:41 user nova-compute[72818]: node.session.iscsi.InitialR2T = No
Aug 17 21:19:41 user nova-compute[72818]: node.session.iscsi.ImmediateData = Yes
Aug 17 21:19:41 user nova-compute[72818]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 21:19:41 user nova-compute[72818]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 21:19:41 user nova-compute[72818]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 21:19:41 user nova-compute[72818]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 21:19:41 user nova-compute[72818]: node.session.iscsi.MaxConnections = 1
Aug 17 21:19:41 user nova-compute[72818]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 21:19:41 user nova-compute[72818]: node.session.iscsi.ERL = 0
Aug 17 21:19:41 user nova-compute[72818]: node.session.scan = manual
Aug 17 21:19:41 user nova-compute[72818]: node.session.reopen_max = 0
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].address = 172.16.0.220
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].port = 3260
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].startup = manual
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].tcp.window_size = 524288
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].tcp.type_of_service = 0
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].timeo.logout_timeout = 15
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].timeo.login_timeout = 15
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].timeo.auth_timeout = 45
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].iscsi.DataDigest = None
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].iscsi.IFMarker = No
Aug 17 21:19:41 user nova-compute[72818]: node.conn[0].iscsi.OFMarker = No
Aug 17 21:19:41 user nova-compute[72818]: # END RECORD
Aug 17 21:19:41 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c52858-4b1f-4118-a9b3-624dadff5ae7]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafd83ad-e05b-443b-80ce-632eb4ef1f83]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrihzSXc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrihzSXc" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecace4a8-52d4-43f0-bea2-7146acba1a87]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QrihzSXc'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03f0e51-2932-421b-9479-417c223ab833]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbcec03-883d-4cfd-8118-463e05eeacdc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:41 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:41 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:41 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:41 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] HCTL ('39', '0', '0', 0) found on session 14 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:19:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09e6ad3-b727-4c82-a97b-a5c5ceed27f1]: (4, ('0 0 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching for a device in session 14 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrihzSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '23264343232313363', 'path': '/dev/sdh'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264343232313363', 'path': '/dev/sdh'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1276307221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1276307221',id=11,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-86p4d4ae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:18:16Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=827d6c12-deb5-4c05-ad6b-efba319783e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "vif_mac": "fa:16:3e:5b:d5:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "vif_mac": "fa:16:3e:5b:d5:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:d5:dd,bridge_name='br-int',has_traffic_filtering=True,id=67586c8a-e841-4778-891e-27307f1dbe67,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67586c8a-e8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'pci_devices' on Instance uuid 827d6c12-deb5-4c05-ad6b-efba319783e9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:19:42 user nova-compute[72818]:   <uuid>827d6c12-deb5-4c05-ad6b-efba319783e9</uuid>
Aug 17 21:19:42 user nova-compute[72818]:   <name>instance-0000000b</name>
Aug 17 21:19:42 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:19:42 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:19:42 user nova-compute[72818]:   <metadata>
Aug 17 21:19:42 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:19:42 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:19:42 user nova-compute[72818]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1276307221</nova:name>
Aug 17 21:19:42 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:19:41</nova:creationTime>
Aug 17 21:19:42 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:19:42 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:19:42 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:19:42 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:19:42 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:19:42 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:19:42 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:19:42 user nova-compute[72818]:       <nova:owner>
Aug 17 21:19:42 user nova-compute[72818]:         <nova:user uuid="6cd1f219a2634975bb1362620392dc1a">tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member</nova:user>
Aug 17 21:19:42 user nova-compute[72818]:         <nova:project uuid="dda0b81a8a39436a9ec6e1646090f637">tempest-ServerBootFromVolumeStableRescueTest-1074783662</nova:project>
Aug 17 21:19:42 user nova-compute[72818]:       </nova:owner>
Aug 17 21:19:42 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:19:42 user nova-compute[72818]:       <nova:ports>
Aug 17 21:19:42 user nova-compute[72818]:         <nova:port uuid="67586c8a-e841-4778-891e-27307f1dbe67">
Aug 17 21:19:42 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 21:19:42 user nova-compute[72818]:         </nova:port>
Aug 17 21:19:42 user nova-compute[72818]:       </nova:ports>
Aug 17 21:19:42 user nova-compute[72818]:     </nova:instance>
Aug 17 21:19:42 user nova-compute[72818]:   </metadata>
Aug 17 21:19:42 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:19:42 user nova-compute[72818]:     <system>
Aug 17 21:19:42 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:19:42 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:19:42 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:19:42 user nova-compute[72818]:       <entry name="serial">827d6c12-deb5-4c05-ad6b-efba319783e9</entry>
Aug 17 21:19:42 user nova-compute[72818]:       <entry name="uuid">827d6c12-deb5-4c05-ad6b-efba319783e9</entry>
Aug 17 21:19:42 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:19:42 user nova-compute[72818]:     </system>
Aug 17 21:19:42 user nova-compute[72818]:   </sysinfo>
Aug 17 21:19:42 user nova-compute[72818]:   <os>
Aug 17 21:19:42 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:19:42 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:19:42 user nova-compute[72818]:   </os>
Aug 17 21:19:42 user nova-compute[72818]:   <features>
Aug 17 21:19:42 user nova-compute[72818]:     <acpi/>
Aug 17 21:19:42 user nova-compute[72818]:     <apic/>
Aug 17 21:19:42 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:19:42 user nova-compute[72818]:   </features>
Aug 17 21:19:42 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:19:42 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:19:42 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:19:42 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:19:42 user nova-compute[72818]:   </clock>
Aug 17 21:19:42 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:19:42 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:19:42 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:19:42 user nova-compute[72818]:   </cpu>
Aug 17 21:19:42 user nova-compute[72818]:   <devices>
Aug 17 21:19:42 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:19:42 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:19:42 user nova-compute[72818]:       <source dev="/dev/sdh"/>
Aug 17 21:19:42 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:19:42 user nova-compute[72818]:       <serial>5a9020bf-fade-4fea-a929-3910080fdf9a</serial>
Aug 17 21:19:42 user nova-compute[72818]:     </disk>
Aug 17 21:19:42 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:19:42 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:19:42 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.rescue"/>
Aug 17 21:19:42 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:19:42 user nova-compute[72818]:       <boot order="1"/>
Aug 17 21:19:42 user nova-compute[72818]:     </disk>
Aug 17 21:19:42 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:19:42 user nova-compute[72818]:       <mac address="fa:16:3e:5b:d5:dd"/>
Aug 17 21:19:42 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:19:42 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:19:42 user nova-compute[72818]:       <target dev="tap67586c8a-e8"/>
Aug 17 21:19:42 user nova-compute[72818]:     </interface>
Aug 17 21:19:42 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:19:42 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/console.log" append="off"/>
Aug 17 21:19:42 user nova-compute[72818]:     </serial>
Aug 17 21:19:42 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:19:42 user nova-compute[72818]:     <video>
Aug 17 21:19:42 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:19:42 user nova-compute[72818]:     </video>
Aug 17 21:19:42 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:19:42 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:19:42 user nova-compute[72818]:     </rng>
Aug 17 21:19:42 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:19:42 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:19:42 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:19:42 user nova-compute[72818]:     </memballoon>
Aug 17 21:19:42 user nova-compute[72818]:   </devices>
Aug 17 21:19:42 user nova-compute[72818]: </domain>
Aug 17 21:19:42 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:19:42 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Instance destroyed successfully.
Aug 17 21:19:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:19:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No VIF found with MAC fa:16:3e:5b:d5:dd, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-5d897d72-815e-4ab5-a10a-69fb014967fb req-73e80cb3-5376-40b0-a20b-101c4a7888a0 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5d897d72-815e-4ab5-a10a-69fb014967fb req-73e80cb3-5376-40b0-a20b-101c4a7888a0 service nova] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5d897d72-815e-4ab5-a10a-69fb014967fb req-73e80cb3-5376-40b0-a20b-101c4a7888a0 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5d897d72-815e-4ab5-a10a-69fb014967fb req-73e80cb3-5376-40b0-a20b-101c4a7888a0 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-5d897d72-815e-4ab5-a10a-69fb014967fb req-73e80cb3-5376-40b0-a20b-101c4a7888a0 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] No waiting events found dispatching network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:43 user nova-compute[72818]: WARNING nova.compute.manager [req-5d897d72-815e-4ab5-a10a-69fb014967fb req-73e80cb3-5376-40b0-a20b-101c4a7888a0 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received unexpected event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 for instance with vm_state active and task_state rescuing.
Aug 17 21:19:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-1bb3e46e-cfea-468b-ac34-821d7a66373f req-57f8e33a-95bd-47df-9474-67751fd3650e service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Received event network-changed-736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-1bb3e46e-cfea-468b-ac34-821d7a66373f req-57f8e33a-95bd-47df-9474-67751fd3650e service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Refreshing instance network info cache due to event network-changed-736f010d-ebe7-49fc-846d-1e12845ecb81. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1bb3e46e-cfea-468b-ac34-821d7a66373f req-57f8e33a-95bd-47df-9474-67751fd3650e service nova] Acquiring lock "refresh_cache-b4a54471-2c50-435f-8e78-e5cdd1b41093" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1bb3e46e-cfea-468b-ac34-821d7a66373f req-57f8e33a-95bd-47df-9474-67751fd3650e service nova] Acquired lock "refresh_cache-b4a54471-2c50-435f-8e78-e5cdd1b41093" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:19:43 user nova-compute[72818]: DEBUG nova.network.neutron [req-1bb3e46e-cfea-468b-ac34-821d7a66373f req-57f8e33a-95bd-47df-9474-67751fd3650e service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Refreshing network info cache for port 736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG nova.objects.instance [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lazy-loading 'flavor' on Instance uuid b4a54471-2c50-435f-8e78-e5cdd1b41093 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:44 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Ignoring supplied device name: /dev/vdb
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:44 user nova-compute[72818]: INFO nova.compute.manager [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Attaching volume 2f22705a-c01e-47fd-ada8-bfc45b2f52d8 to /dev/vdb
Aug 17 21:19:44 user nova-compute[72818]: DEBUG os_brick.utils [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9cfe9c-ec92-47ad-92ca-a8d101f0e9d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7f6a84-1622-4713-9f2b-b6d6f187792b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdacce94-8bd5-4fc7-bdc1-3970c572fa2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac331860-e405-4d90-81d9-e518757906ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:19:44 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8064218d-f84d-4b46-958a-37a94a9f6168]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG os_brick.utils [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Updating existing volume attachment record: a1f1447e-90f2-4a80-8dbd-7d52051d6f29 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG nova.network.neutron [req-1bb3e46e-cfea-468b-ac34-821d7a66373f req-57f8e33a-95bd-47df-9474-67751fd3650e service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Updated VIF entry in instance network info cache for port 736f010d-ebe7-49fc-846d-1e12845ecb81. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG nova.network.neutron [req-1bb3e46e-cfea-468b-ac34-821d7a66373f req-57f8e33a-95bd-47df-9474-67751fd3650e service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Updating instance_info_cache with network_info: [{"id": "736f010d-ebe7-49fc-846d-1e12845ecb81", "address": "fa:16:3e:71:ff:2d", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736f010d-eb", "ovs_interfaceid": "736f010d-ebe7-49fc-846d-1e12845ecb81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1bb3e46e-cfea-468b-ac34-821d7a66373f req-57f8e33a-95bd-47df-9474-67751fd3650e service nova] Releasing lock "refresh_cache-b4a54471-2c50-435f-8e78-e5cdd1b41093" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:19:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-6f97875f-97ce-4de0-a055-336ff244a014 req-a485d91b-71c3-4654-9ada-2d8044b2cee7 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:19:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6f97875f-97ce-4de0-a055-336ff244a014 req-a485d91b-71c3-4654-9ada-2d8044b2cee7 service nova] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6f97875f-97ce-4de0-a055-336ff244a014 req-a485d91b-71c3-4654-9ada-2d8044b2cee7 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6f97875f-97ce-4de0-a055-336ff244a014 req-a485d91b-71c3-4654-9ada-2d8044b2cee7 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-6f97875f-97ce-4de0-a055-336ff244a014 req-a485d91b-71c3-4654-9ada-2d8044b2cee7 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] No waiting events found dispatching network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:19:45 user nova-compute[72818]: WARNING nova.compute.manager [req-6f97875f-97ce-4de0-a055-336ff244a014 req-a485d91b-71c3-4654-9ada-2d8044b2cee7 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received unexpected event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 for instance with vm_state active and task_state rescuing.
Aug 17 21:19:45 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for 827d6c12-deb5-4c05-ad6b-efba319783e9 due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 21:19:45 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307185.871301, 827d6c12-deb5-4c05-ad6b-efba319783e9 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:19:45 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] VM Resumed (Lifecycle Event)
Aug 17 21:19:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d568b852-2e4d-42d1-aac6-b028ae2544ff tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:19:45 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 21:19:45 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307185.8828156, 827d6c12-deb5-4c05-ad6b-efba319783e9 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:19:45 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] VM Started (Lifecycle Event)
Aug 17 21:19:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:19:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:19:46 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 21:19:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:47 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:19:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:19:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:19:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:19:48 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:19:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:48 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Updating instance_info_cache with network_info: [{"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:19:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:19:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:19:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:19:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:19:49 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:19:49 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:19:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:19:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:51 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:19:51 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:19:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:52 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:19:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:52 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:19:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:19:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:19:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:19:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XSHWdrCk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:19:57 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:57 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:19:57 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbff92eb-730e-4527-842f-3f620df6b7f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:19:57 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e5cf00-9b56-4877-a9c5-bb48825298fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8] added
Aug 17 21:19:57 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[668b0752-b96c-4a77-b132-ac8d4bbbb048]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3963d2f6-36d7-460d-a91e-568d8c437d0c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XSHWdrCk {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XSHWdrCk" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[010864e7-6333-455a-aae8-3e6694abfc41]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XSHWdrCk'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c831fed-ab87-46c0-8875-89224ee9d45f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb76460-4653-4002-9123-e6d0dff80d9b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:57 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:57 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:57 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:57 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[670fa715-f499-410f-aff2-e5ba03914e70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8, portal: 172.16.0.220,3260]
Aug 17 21:19:57 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8, portal: 172.16.0.220,3260] successful.
Aug 17 21:19:57 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[002eefb2-8b93-417a-9d0e-748e4e293f41]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e483e09-2950-416b-adf3-cd501490f18c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:57 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:57 user nova-compute[72818]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 (non-flash)
Aug 17 21:19:57 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:19:57 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:19:57 user nova-compute[72818]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 (non-flash)
Aug 17 21:19:57 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.832s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:19:57 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:19:57 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:19:57 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7246MB free_disk=25.515987396240234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fc3ed5-96c3-4181-ab98-61ad0c281172]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:19:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XSHWdrCk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b93c6b2f-59ee-4e7f-9805-97ef627eccdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b4a54471-2c50-435f-8e78-e5cdd1b41093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e8b5ccab-5dff-4458-a799-8c8528a032b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 03cea654-4432-45b4-940b-64a55568f35a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.876s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] <== connect_volume: return (1879ms) {'type': 'block', 'scsi_wwn': '23337396361356331', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337396361356331', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:19:58 user nova-compute[72818]: DEBUG nova.objects.instance [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lazy-loading 'flavor' on Instance uuid b4a54471-2c50-435f-8e78-e5cdd1b41093 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:19:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:19:59 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:19:59 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:19:59 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:19:59 user nova-compute[72818]:   <serial>2f22705a-c01e-47fd-ada8-bfc45b2f52d8</serial>
Aug 17 21:19:59 user nova-compute[72818]: </disk>
Aug 17 21:19:59 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:19:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:19:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:19:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] No VIF found with MAC fa:16:3e:71:ff:2d, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:19:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e9c6386a-e6b8-4c31-a98e-3302f0b19e6d tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.300s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-3e618cd9-2338-4775-9440-76fac193cf76 req-215f9ac1-9cdf-4e3b-9d81-15d4aaad1c14 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-changed-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-3e618cd9-2338-4775-9440-76fac193cf76 req-215f9ac1-9cdf-4e3b-9d81-15d4aaad1c14 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Refreshing instance network info cache due to event network-changed-25efe920-cfdf-428d-86ee-0f9b8f301e11. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:20:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3e618cd9-2338-4775-9440-76fac193cf76 req-215f9ac1-9cdf-4e3b-9d81-15d4aaad1c14 service nova] Acquiring lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:20:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3e618cd9-2338-4775-9440-76fac193cf76 req-215f9ac1-9cdf-4e3b-9d81-15d4aaad1c14 service nova] Acquired lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:20:09 user nova-compute[72818]: DEBUG nova.network.neutron [req-3e618cd9-2338-4775-9440-76fac193cf76 req-215f9ac1-9cdf-4e3b-9d81-15d4aaad1c14 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Refreshing network info cache for port 25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:20:10 user nova-compute[72818]: DEBUG nova.network.neutron [req-3e618cd9-2338-4775-9440-76fac193cf76 req-215f9ac1-9cdf-4e3b-9d81-15d4aaad1c14 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updated VIF entry in instance network info cache for port 25efe920-cfdf-428d-86ee-0f9b8f301e11. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:20:10 user nova-compute[72818]: DEBUG nova.network.neutron [req-3e618cd9-2338-4775-9440-76fac193cf76 req-215f9ac1-9cdf-4e3b-9d81-15d4aaad1c14 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating instance_info_cache with network_info: [{"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:20:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3e618cd9-2338-4775-9440-76fac193cf76 req-215f9ac1-9cdf-4e3b-9d81-15d4aaad1c14 service nova] Releasing lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:20:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:20:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:20:15 user nova-compute[72818]: INFO nova.compute.claims [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Claim successful on node user
Aug 17 21:20:16 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:20:16 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:20:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG nova.policy [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86cb8a969924487b8362d340d0bd31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5202a87dcf64b979cce5074783790f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:20:16 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Creating image(s)
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "/opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "/opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.226s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk 1073741824" returned: 0 in 0.052s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.201s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Successfully created port: c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Cannot resize image /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'migration_context' on Instance uuid ac704cc9-16b1-4bf5-830a-f1ca33c97c6a {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Ensure instance console log exists: /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Successfully updated port: c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquired lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-2b75e19d-448e-4855-921e-ffaf772393e8 req-927ed298-f981-4e53-920c-df859b8f7f93 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Received event network-changed-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-2b75e19d-448e-4855-921e-ffaf772393e8 req-927ed298-f981-4e53-920c-df859b8f7f93 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Refreshing instance network info cache due to event network-changed-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2b75e19d-448e-4855-921e-ffaf772393e8 req-927ed298-f981-4e53-920c-df859b8f7f93 service nova] Acquiring lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:20:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updating instance_info_cache with network_info: [{"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Releasing lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Instance network_info: |[{"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2b75e19d-448e-4855-921e-ffaf772393e8 req-927ed298-f981-4e53-920c-df859b8f7f93 service nova] Acquired lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.network.neutron [req-2b75e19d-448e-4855-921e-ffaf772393e8 req-927ed298-f981-4e53-920c-df859b8f7f93 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Refreshing network info cache for port c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Start _get_guest_xml network_info=[{"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:20:18 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:20:18 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1201093147',display_name='tempest-ServerActionsTestOtherA-server-1201093147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1201093147',id=17,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV/yxdZf0gbz0Oc0hEv4WwXP2jV20fy0LitgWYnfEN52KHQjmeuLO48ZiCuSailjRm1wHuszXDlB837Vche8MvGzjfdhLQW/IYo033/9mpCOWKkYkF4Ly8lZgNbXJbUlw==',key_name='tempest-keypair-570023473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-h4pgw0dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=ac704cc9-16b1-4bf5-830a-f1ca33c97c6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:13:3e,bridge_name='br-int',has_traffic_filtering=True,id=c48bf93f-2922-454f-a8ac-f8a92d7b0b6a,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48bf93f-29') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'pci_devices' on Instance uuid ac704cc9-16b1-4bf5-830a-f1ca33c97c6a {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:20:18 user nova-compute[72818]:   <uuid>ac704cc9-16b1-4bf5-830a-f1ca33c97c6a</uuid>
Aug 17 21:20:18 user nova-compute[72818]:   <name>instance-00000011</name>
Aug 17 21:20:18 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:20:18 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:20:18 user nova-compute[72818]:   <metadata>
Aug 17 21:20:18 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:20:18 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:20:18 user nova-compute[72818]:       <nova:name>tempest-ServerActionsTestOtherA-server-1201093147</nova:name>
Aug 17 21:20:18 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:20:18</nova:creationTime>
Aug 17 21:20:18 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:20:18 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:20:18 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:20:18 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:20:18 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:20:18 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:20:18 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:20:18 user nova-compute[72818]:       <nova:owner>
Aug 17 21:20:18 user nova-compute[72818]:         <nova:user uuid="86cb8a969924487b8362d340d0bd31b5">tempest-ServerActionsTestOtherA-1230434837-project-member</nova:user>
Aug 17 21:20:18 user nova-compute[72818]:         <nova:project uuid="d5202a87dcf64b979cce5074783790f9">tempest-ServerActionsTestOtherA-1230434837</nova:project>
Aug 17 21:20:18 user nova-compute[72818]:       </nova:owner>
Aug 17 21:20:18 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:20:18 user nova-compute[72818]:       <nova:ports>
Aug 17 21:20:18 user nova-compute[72818]:         <nova:port uuid="c48bf93f-2922-454f-a8ac-f8a92d7b0b6a">
Aug 17 21:20:18 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 21:20:18 user nova-compute[72818]:         </nova:port>
Aug 17 21:20:18 user nova-compute[72818]:       </nova:ports>
Aug 17 21:20:18 user nova-compute[72818]:     </nova:instance>
Aug 17 21:20:18 user nova-compute[72818]:   </metadata>
Aug 17 21:20:18 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:20:18 user nova-compute[72818]:     <system>
Aug 17 21:20:18 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:20:18 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:20:18 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:20:18 user nova-compute[72818]:       <entry name="serial">ac704cc9-16b1-4bf5-830a-f1ca33c97c6a</entry>
Aug 17 21:20:18 user nova-compute[72818]:       <entry name="uuid">ac704cc9-16b1-4bf5-830a-f1ca33c97c6a</entry>
Aug 17 21:20:18 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:20:18 user nova-compute[72818]:     </system>
Aug 17 21:20:18 user nova-compute[72818]:   </sysinfo>
Aug 17 21:20:18 user nova-compute[72818]:   <os>
Aug 17 21:20:18 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:20:18 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:20:18 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:20:18 user nova-compute[72818]:   </os>
Aug 17 21:20:18 user nova-compute[72818]:   <features>
Aug 17 21:20:18 user nova-compute[72818]:     <acpi/>
Aug 17 21:20:18 user nova-compute[72818]:     <apic/>
Aug 17 21:20:18 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:20:18 user nova-compute[72818]:   </features>
Aug 17 21:20:18 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:20:18 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:20:18 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:20:18 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:20:18 user nova-compute[72818]:   </clock>
Aug 17 21:20:18 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:20:18 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:20:18 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:20:18 user nova-compute[72818]:   </cpu>
Aug 17 21:20:18 user nova-compute[72818]:   <devices>
Aug 17 21:20:18 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:20:18 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:20:18 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk"/>
Aug 17 21:20:18 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:20:18 user nova-compute[72818]:     </disk>
Aug 17 21:20:18 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:20:18 user nova-compute[72818]:       <mac address="fa:16:3e:b7:13:3e"/>
Aug 17 21:20:18 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:20:18 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:20:18 user nova-compute[72818]:       <target dev="tapc48bf93f-29"/>
Aug 17 21:20:18 user nova-compute[72818]:     </interface>
Aug 17 21:20:18 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:20:18 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/console.log" append="off"/>
Aug 17 21:20:18 user nova-compute[72818]:     </serial>
Aug 17 21:20:18 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:20:18 user nova-compute[72818]:     <video>
Aug 17 21:20:18 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:20:18 user nova-compute[72818]:     </video>
Aug 17 21:20:18 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:20:18 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:20:18 user nova-compute[72818]:     </rng>
Aug 17 21:20:18 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:20:18 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:20:18 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:20:18 user nova-compute[72818]:     </memballoon>
Aug 17 21:20:18 user nova-compute[72818]:   </devices>
Aug 17 21:20:18 user nova-compute[72818]: </domain>
Aug 17 21:20:18 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1201093147',display_name='tempest-ServerActionsTestOtherA-server-1201093147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1201093147',id=17,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV/yxdZf0gbz0Oc0hEv4WwXP2jV20fy0LitgWYnfEN52KHQjmeuLO48ZiCuSailjRm1wHuszXDlB837Vche8MvGzjfdhLQW/IYo033/9mpCOWKkYkF4Ly8lZgNbXJbUlw==',key_name='tempest-keypair-570023473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-h4pgw0dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=ac704cc9-16b1-4bf5-830a-f1ca33c97c6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:13:3e,bridge_name='br-int',has_traffic_filtering=True,id=c48bf93f-2922-454f-a8ac-f8a92d7b0b6a,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48bf93f-29') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG os_vif [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:13:3e,bridge_name='br-int',has_traffic_filtering=True,id=c48bf93f-2922-454f-a8ac-f8a92d7b0b6a,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48bf93f-29') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc48bf93f-29, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc48bf93f-29, col_values=(('external_ids', {'iface-id': 'c48bf93f-2922-454f-a8ac-f8a92d7b0b6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:13:3e', 'vm-uuid': 'ac704cc9-16b1-4bf5-830a-f1ca33c97c6a'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:18 user nova-compute[72818]: INFO os_vif [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:13:3e,bridge_name='br-int',has_traffic_filtering=True,id=c48bf93f-2922-454f-a8ac-f8a92d7b0b6a,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48bf93f-29')
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] No VIF found with MAC fa:16:3e:b7:13:3e, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.network.neutron [req-2b75e19d-448e-4855-921e-ffaf772393e8 req-927ed298-f981-4e53-920c-df859b8f7f93 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updated VIF entry in instance network info cache for port c48bf93f-2922-454f-a8ac-f8a92d7b0b6a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG nova.network.neutron [req-2b75e19d-448e-4855-921e-ffaf772393e8 req-927ed298-f981-4e53-920c-df859b8f7f93 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updating instance_info_cache with network_info: [{"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:20:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2b75e19d-448e-4855-921e-ffaf772393e8 req-927ed298-f981-4e53-920c-df859b8f7f93 service nova] Releasing lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:20:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-83a75dbb-3c17-42dc-aa8c-c12bd641b74b req-e3f8118d-f30c-4d84-9cab-36d5683e627f service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Received event network-vif-plugged-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-83a75dbb-3c17-42dc-aa8c-c12bd641b74b req-e3f8118d-f30c-4d84-9cab-36d5683e627f service nova] Acquiring lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-83a75dbb-3c17-42dc-aa8c-c12bd641b74b req-e3f8118d-f30c-4d84-9cab-36d5683e627f service nova] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-83a75dbb-3c17-42dc-aa8c-c12bd641b74b req-e3f8118d-f30c-4d84-9cab-36d5683e627f service nova] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-83a75dbb-3c17-42dc-aa8c-c12bd641b74b req-e3f8118d-f30c-4d84-9cab-36d5683e627f service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] No waiting events found dispatching network-vif-plugged-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:20:20 user nova-compute[72818]: WARNING nova.compute.manager [req-83a75dbb-3c17-42dc-aa8c-c12bd641b74b req-e3f8118d-f30c-4d84-9cab-36d5683e627f service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Received unexpected event network-vif-plugged-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a for instance with vm_state building and task_state spawning.
Aug 17 21:20:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-3148a686-7b27-491b-9d13-5501612acb2b req-4eda7f2b-aa2e-4736-a8df-2fe4db5486b7 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Received event network-vif-plugged-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3148a686-7b27-491b-9d13-5501612acb2b req-4eda7f2b-aa2e-4736-a8df-2fe4db5486b7 service nova] Acquiring lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3148a686-7b27-491b-9d13-5501612acb2b req-4eda7f2b-aa2e-4736-a8df-2fe4db5486b7 service nova] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3148a686-7b27-491b-9d13-5501612acb2b req-4eda7f2b-aa2e-4736-a8df-2fe4db5486b7 service nova] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-3148a686-7b27-491b-9d13-5501612acb2b req-4eda7f2b-aa2e-4736-a8df-2fe4db5486b7 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] No waiting events found dispatching network-vif-plugged-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:20:22 user nova-compute[72818]: WARNING nova.compute.manager [req-3148a686-7b27-491b-9d13-5501612acb2b req-4eda7f2b-aa2e-4736-a8df-2fe4db5486b7 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Received unexpected event network-vif-plugged-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a for instance with vm_state building and task_state spawning.
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307222.8396838, ac704cc9-16b1-4bf5-830a-f1ca33c97c6a => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:20:22 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] VM Resumed (Lifecycle Event)
Aug 17 21:20:22 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Instance spawned successfully.
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:20:22 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:20:22 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307222.8418443, ac704cc9-16b1-4bf5-830a-f1ca33c97c6a => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:20:22 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] VM Started (Lifecycle Event)
Aug 17 21:20:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:20:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:20:23 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:20:23 user nova-compute[72818]: INFO nova.compute.manager [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Took 6.80 seconds to spawn the instance on the hypervisor.
Aug 17 21:20:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:20:23 user nova-compute[72818]: INFO nova.compute.manager [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Took 7.61 seconds to build instance.
Aug 17 21:20:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9f13185-7b7a-45df-ba63-1990ac02d8b0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.720s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:20:24 user nova-compute[72818]: INFO nova.compute.manager [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] instance snapshotting
Aug 17 21:20:24 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Beginning live snapshot process
Aug 17 21:20:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json -f qcow2 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json -f qcow2 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.268s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcktuiqom/6bd00fbc369c45f19f31cadb921d7d58.delta 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcktuiqom/6bd00fbc369c45f19f31cadb921d7d58.delta 1073741824" returned: 0 in 0.055s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:25 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 21:20:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72818) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 21:20:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] COPY block job progress, current cursor: 19202048 final cursor: 75563008 {{(pid=72818) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 21:20:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72818) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 21:20:27 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 21:20:27 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:20:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcktuiqom/6bd00fbc369c45f19f31cadb921d7d58.delta /opt/stack/data/nova/instances/snapshots/tmpcktuiqom/6bd00fbc369c45f19f31cadb921d7d58 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcktuiqom/6bd00fbc369c45f19f31cadb921d7d58.delta /opt/stack/data/nova/instances/snapshots/tmpcktuiqom/6bd00fbc369c45f19f31cadb921d7d58" returned: 0 in 0.258s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:27 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Snapshot extracted, beginning image upload
Aug 17 21:20:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:30 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Snapshot image upload complete
Aug 17 21:20:30 user nova-compute[72818]: INFO nova.compute.manager [None req-ec1798d0-b571-48f5-abc5-dbca204d350e tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Took 6.17 seconds to snapshot the instance on the hypervisor.
Aug 17 21:20:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:20:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:20:32 user nova-compute[72818]: INFO nova.compute.claims [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Claim successful on node user
Aug 17 21:20:32 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:20:32 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:20:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:20:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG nova.policy [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '790700df1c8549699854d5a0aa6e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae77104eaa942eca3d579618e78ccc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:20:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Creating image(s)
Aug 17 21:20:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "/opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "/opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "/opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "e8ac6b3c85815823af565cc8f13c1f02c02d5dc4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "e8ac6b3c85815823af565cc8f13c1f02c02d5dc4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:20:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4.part --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4.part --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:34 user nova-compute[72818]: DEBUG nova.virt.images [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] 62a86228-e660-482e-a794-cb6db417917c was qcow2, converting to raw {{(pid=72818) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 21:20:34 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:20:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4.part /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4.converted {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Successfully created port: 35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4.part /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4.converted" returned: 0 in 0.591s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4.converted --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4.converted --force-share --output=json" returned: 0 in 0.235s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "e8ac6b3c85815823af565cc8f13c1f02c02d5dc4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.926s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4 --force-share --output=json" returned: 0 in 0.206s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "e8ac6b3c85815823af565cc8f13c1f02c02d5dc4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "e8ac6b3c85815823af565cc8f13c1f02c02d5dc4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4 --force-share --output=json" returned: 0 in 0.242s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4,backing_fmt=raw /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4,backing_fmt=raw /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk 1073741824" returned: 0 in 0.062s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "e8ac6b3c85815823af565cc8f13c1f02c02d5dc4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Successfully updated port: 35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "refresh_cache-be9e52eb-e0db-4b00-aa69-b8506b2275fe" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquired lock "refresh_cache-be9e52eb-e0db-4b00-aa69-b8506b2275fe" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:20:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-67ab2031-6665-42ed-abe4-3d31e8c1062c req-86bada07-e210-4782-be44-37bceb526a55 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Received event network-changed-35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-67ab2031-6665-42ed-abe4-3d31e8c1062c req-86bada07-e210-4782-be44-37bceb526a55 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Refreshing instance network info cache due to event network-changed-35432717-090b-446d-b18d-10fd618b2cf9. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-67ab2031-6665-42ed-abe4-3d31e8c1062c req-86bada07-e210-4782-be44-37bceb526a55 service nova] Acquiring lock "refresh_cache-be9e52eb-e0db-4b00-aa69-b8506b2275fe" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4 --force-share --output=json" returned: 0 in 0.241s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lazy-loading 'migration_context' on Instance uuid be9e52eb-e0db-4b00-aa69-b8506b2275fe {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Ensure instance console log exists: /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Updating instance_info_cache with network_info: [{"id": "35432717-090b-446d-b18d-10fd618b2cf9", "address": "fa:16:3e:82:95:1b", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35432717-09", "ovs_interfaceid": "35432717-090b-446d-b18d-10fd618b2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Releasing lock "refresh_cache-be9e52eb-e0db-4b00-aa69-b8506b2275fe" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Instance network_info: |[{"id": "35432717-090b-446d-b18d-10fd618b2cf9", "address": "fa:16:3e:82:95:1b", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35432717-09", "ovs_interfaceid": "35432717-090b-446d-b18d-10fd618b2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-67ab2031-6665-42ed-abe4-3d31e8c1062c req-86bada07-e210-4782-be44-37bceb526a55 service nova] Acquired lock "refresh_cache-be9e52eb-e0db-4b00-aa69-b8506b2275fe" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.network.neutron [req-67ab2031-6665-42ed-abe4-3d31e8c1062c req-86bada07-e210-4782-be44-37bceb526a55 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Refreshing network info cache for port 35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Start _get_guest_xml network_info=[{"id": "35432717-090b-446d-b18d-10fd618b2cf9", "address": "fa:16:3e:82:95:1b", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35432717-09", "ovs_interfaceid": "35432717-090b-446d-b18d-10fd618b2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='083d56055a202baf55bccb26f1c86806',container_format='bare',created_at=2023-08-17T21:20:24Z,direct_url=<?>,disk_format='qcow2',id=62a86228-e660-482e-a794-cb6db417917c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-815142302',owner='0ae77104eaa942eca3d579618e78ccc9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T21:20:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '62a86228-e660-482e-a794-cb6db417917c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:20:36 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:20:36 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='083d56055a202baf55bccb26f1c86806',container_format='bare',created_at=2023-08-17T21:20:24Z,direct_url=<?>,disk_format='qcow2',id=62a86228-e660-482e-a794-cb6db417917c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-815142302',owner='0ae77104eaa942eca3d579618e78ccc9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T21:20:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1499227667',display_name='tempest-TestStampPattern-server-1499227667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1499227667',id=18,image_ref='62a86228-e660-482e-a794-cb6db417917c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOg12rwG0goFcEOqfjeVkLRdQHA4VYmkHTOdp9mo/FLMqnHH8awtzuou6HfZ30eiO4Lj+EDhkp42MExzTbcAj8c21NG1Hgsi9ewpnMwejZ3D3SuTfwK1a/C6Q0zNej4H8Q==',key_name='tempest-TestStampPattern-158492147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ae77104eaa942eca3d579618e78ccc9',ramdisk_id='',reservation_id='r-j98fwc7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='48b00603-33ea-4eaa-b445-934ba1ab88f4',image_min_disk='1',image_min_ram='0',image_owner_id='0ae77104eaa942eca3d579618e78ccc9',image_owner_project_name='tempest-TestStampPattern-1752250551',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1752250551-project-member',image_user_id='790700df1c8549699854d5a0aa6e5566',network_allocated='True',owner_project_name='tempest-TestStampPattern-1752250551',owner_user_name='tempest-TestStampPattern-1752250551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:20:33Z,user_data=None,user_id='790700df1c8549699854d5a0aa6e5566',uuid=be9e52eb-e0db-4b00-aa69-b8506b2275fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35432717-090b-446d-b18d-10fd618b2cf9", "address": "fa:16:3e:82:95:1b", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35432717-09", "ovs_interfaceid": "35432717-090b-446d-b18d-10fd618b2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Converting VIF {"id": "35432717-090b-446d-b18d-10fd618b2cf9", "address": "fa:16:3e:82:95:1b", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35432717-09", "ovs_interfaceid": "35432717-090b-446d-b18d-10fd618b2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=35432717-090b-446d-b18d-10fd618b2cf9,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35432717-09') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lazy-loading 'pci_devices' on Instance uuid be9e52eb-e0db-4b00-aa69-b8506b2275fe {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:20:36 user nova-compute[72818]:   <uuid>be9e52eb-e0db-4b00-aa69-b8506b2275fe</uuid>
Aug 17 21:20:36 user nova-compute[72818]:   <name>instance-00000012</name>
Aug 17 21:20:36 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:20:36 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:20:36 user nova-compute[72818]:   <metadata>
Aug 17 21:20:36 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:20:36 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:20:36 user nova-compute[72818]:       <nova:name>tempest-TestStampPattern-server-1499227667</nova:name>
Aug 17 21:20:36 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:20:36</nova:creationTime>
Aug 17 21:20:36 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:20:36 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:20:36 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:20:36 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:20:36 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:20:36 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:20:36 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:20:36 user nova-compute[72818]:       <nova:owner>
Aug 17 21:20:36 user nova-compute[72818]:         <nova:user uuid="790700df1c8549699854d5a0aa6e5566">tempest-TestStampPattern-1752250551-project-member</nova:user>
Aug 17 21:20:36 user nova-compute[72818]:         <nova:project uuid="0ae77104eaa942eca3d579618e78ccc9">tempest-TestStampPattern-1752250551</nova:project>
Aug 17 21:20:36 user nova-compute[72818]:       </nova:owner>
Aug 17 21:20:36 user nova-compute[72818]:       <nova:root type="image" uuid="62a86228-e660-482e-a794-cb6db417917c"/>
Aug 17 21:20:36 user nova-compute[72818]:       <nova:ports>
Aug 17 21:20:36 user nova-compute[72818]:         <nova:port uuid="35432717-090b-446d-b18d-10fd618b2cf9">
Aug 17 21:20:36 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 21:20:36 user nova-compute[72818]:         </nova:port>
Aug 17 21:20:36 user nova-compute[72818]:       </nova:ports>
Aug 17 21:20:36 user nova-compute[72818]:     </nova:instance>
Aug 17 21:20:36 user nova-compute[72818]:   </metadata>
Aug 17 21:20:36 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:20:36 user nova-compute[72818]:     <system>
Aug 17 21:20:36 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:20:36 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:20:36 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:20:36 user nova-compute[72818]:       <entry name="serial">be9e52eb-e0db-4b00-aa69-b8506b2275fe</entry>
Aug 17 21:20:36 user nova-compute[72818]:       <entry name="uuid">be9e52eb-e0db-4b00-aa69-b8506b2275fe</entry>
Aug 17 21:20:36 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:20:36 user nova-compute[72818]:     </system>
Aug 17 21:20:36 user nova-compute[72818]:   </sysinfo>
Aug 17 21:20:36 user nova-compute[72818]:   <os>
Aug 17 21:20:36 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:20:36 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:20:36 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:20:36 user nova-compute[72818]:   </os>
Aug 17 21:20:36 user nova-compute[72818]:   <features>
Aug 17 21:20:36 user nova-compute[72818]:     <acpi/>
Aug 17 21:20:36 user nova-compute[72818]:     <apic/>
Aug 17 21:20:36 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:20:36 user nova-compute[72818]:   </features>
Aug 17 21:20:36 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:20:36 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:20:36 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:20:36 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:20:36 user nova-compute[72818]:   </clock>
Aug 17 21:20:36 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:20:36 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:20:36 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:20:36 user nova-compute[72818]:   </cpu>
Aug 17 21:20:36 user nova-compute[72818]:   <devices>
Aug 17 21:20:36 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:20:36 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:20:36 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk"/>
Aug 17 21:20:36 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:20:36 user nova-compute[72818]:     </disk>
Aug 17 21:20:36 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:20:36 user nova-compute[72818]:       <mac address="fa:16:3e:82:95:1b"/>
Aug 17 21:20:36 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:20:36 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:20:36 user nova-compute[72818]:       <target dev="tap35432717-09"/>
Aug 17 21:20:36 user nova-compute[72818]:     </interface>
Aug 17 21:20:36 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:20:36 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/console.log" append="off"/>
Aug 17 21:20:36 user nova-compute[72818]:     </serial>
Aug 17 21:20:36 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:20:36 user nova-compute[72818]:     <video>
Aug 17 21:20:36 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:20:36 user nova-compute[72818]:     </video>
Aug 17 21:20:36 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:20:36 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:20:36 user nova-compute[72818]:     </rng>
Aug 17 21:20:36 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:20:36 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:20:36 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:20:36 user nova-compute[72818]:     </memballoon>
Aug 17 21:20:36 user nova-compute[72818]:   </devices>
Aug 17 21:20:36 user nova-compute[72818]: </domain>
Aug 17 21:20:36 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1499227667',display_name='tempest-TestStampPattern-server-1499227667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1499227667',id=18,image_ref='62a86228-e660-482e-a794-cb6db417917c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOg12rwG0goFcEOqfjeVkLRdQHA4VYmkHTOdp9mo/FLMqnHH8awtzuou6HfZ30eiO4Lj+EDhkp42MExzTbcAj8c21NG1Hgsi9ewpnMwejZ3D3SuTfwK1a/C6Q0zNej4H8Q==',key_name='tempest-TestStampPattern-158492147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ae77104eaa942eca3d579618e78ccc9',ramdisk_id='',reservation_id='r-j98fwc7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='48b00603-33ea-4eaa-b445-934ba1ab88f4',image_min_disk='1',image_min_ram='0',image_owner_id='0ae77104eaa942eca3d579618e78ccc9',image_owner_project_name='tempest-TestStampPattern-1752250551',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1752250551-project-member',image_user_id='790700df1c8549699854d5a0aa6e5566',network_allocated='True',owner_project_name='tempest-TestStampPattern-1752250551',owner_user_name='tempest-TestStampPattern-1752250551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:20:33Z,user_data=None,user_id='790700df1c8549699854d5a0aa6e5566',uuid=be9e52eb-e0db-4b00-aa69-b8506b2275fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35432717-090b-446d-b18d-10fd618b2cf9", "address": "fa:16:3e:82:95:1b", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35432717-09", "ovs_interfaceid": "35432717-090b-446d-b18d-10fd618b2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Converting VIF {"id": "35432717-090b-446d-b18d-10fd618b2cf9", "address": "fa:16:3e:82:95:1b", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35432717-09", "ovs_interfaceid": "35432717-090b-446d-b18d-10fd618b2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=35432717-090b-446d-b18d-10fd618b2cf9,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35432717-09') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG os_vif [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=35432717-090b-446d-b18d-10fd618b2cf9,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35432717-09') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35432717-09, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35432717-09, col_values=(('external_ids', {'iface-id': '35432717-090b-446d-b18d-10fd618b2cf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:95:1b', 'vm-uuid': 'be9e52eb-e0db-4b00-aa69-b8506b2275fe'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:36 user nova-compute[72818]: INFO os_vif [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=35432717-090b-446d-b18d-10fd618b2cf9,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35432717-09')
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:20:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] No VIF found with MAC fa:16:3e:82:95:1b, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:20:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-67ab2031-6665-42ed-abe4-3d31e8c1062c req-86bada07-e210-4782-be44-37bceb526a55 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Updated VIF entry in instance network info cache for port 35432717-090b-446d-b18d-10fd618b2cf9. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:20:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-67ab2031-6665-42ed-abe4-3d31e8c1062c req-86bada07-e210-4782-be44-37bceb526a55 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Updating instance_info_cache with network_info: [{"id": "35432717-090b-446d-b18d-10fd618b2cf9", "address": "fa:16:3e:82:95:1b", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35432717-09", "ovs_interfaceid": "35432717-090b-446d-b18d-10fd618b2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:20:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-67ab2031-6665-42ed-abe4-3d31e8c1062c req-86bada07-e210-4782-be44-37bceb526a55 service nova] Releasing lock "refresh_cache-be9e52eb-e0db-4b00-aa69-b8506b2275fe" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:20:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-c0ef322c-f874-40d6-98d9-3a39fdfffca1 req-05ac4fdf-151e-4761-a293-6bc7e7fc0e48 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Received event network-vif-plugged-35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c0ef322c-f874-40d6-98d9-3a39fdfffca1 req-05ac4fdf-151e-4761-a293-6bc7e7fc0e48 service nova] Acquiring lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c0ef322c-f874-40d6-98d9-3a39fdfffca1 req-05ac4fdf-151e-4761-a293-6bc7e7fc0e48 service nova] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c0ef322c-f874-40d6-98d9-3a39fdfffca1 req-05ac4fdf-151e-4761-a293-6bc7e7fc0e48 service nova] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-c0ef322c-f874-40d6-98d9-3a39fdfffca1 req-05ac4fdf-151e-4761-a293-6bc7e7fc0e48 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] No waiting events found dispatching network-vif-plugged-35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:20:38 user nova-compute[72818]: WARNING nova.compute.manager [req-c0ef322c-f874-40d6-98d9-3a39fdfffca1 req-05ac4fdf-151e-4761-a293-6bc7e7fc0e48 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Received unexpected event network-vif-plugged-35432717-090b-446d-b18d-10fd618b2cf9 for instance with vm_state building and task_state spawning.
Aug 17 21:20:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2e0ed5f-1cb4-4644-9319-bebbc4d03fef req-89ceb073-2d05-4fca-be01-9d2ad4bc27f9 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Received event network-vif-plugged-35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2e0ed5f-1cb4-4644-9319-bebbc4d03fef req-89ceb073-2d05-4fca-be01-9d2ad4bc27f9 service nova] Acquiring lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2e0ed5f-1cb4-4644-9319-bebbc4d03fef req-89ceb073-2d05-4fca-be01-9d2ad4bc27f9 service nova] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2e0ed5f-1cb4-4644-9319-bebbc4d03fef req-89ceb073-2d05-4fca-be01-9d2ad4bc27f9 service nova] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2e0ed5f-1cb4-4644-9319-bebbc4d03fef req-89ceb073-2d05-4fca-be01-9d2ad4bc27f9 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] No waiting events found dispatching network-vif-plugged-35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:20:40 user nova-compute[72818]: WARNING nova.compute.manager [req-d2e0ed5f-1cb4-4644-9319-bebbc4d03fef req-89ceb073-2d05-4fca-be01-9d2ad4bc27f9 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Received unexpected event network-vif-plugged-35432717-090b-446d-b18d-10fd618b2cf9 for instance with vm_state building and task_state spawning.
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307240.8708856, be9e52eb-e0db-4b00-aa69-b8506b2275fe => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:20:40 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] VM Resumed (Lifecycle Event)
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:20:40 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Instance spawned successfully.
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:20:40 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307240.8730876, be9e52eb-e0db-4b00-aa69-b8506b2275fe => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:20:40 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] VM Started (Lifecycle Event)
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:20:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:20:41 user nova-compute[72818]: INFO nova.compute.manager [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Took 7.62 seconds to spawn the instance on the hypervisor.
Aug 17 21:20:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:20:41 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:20:41 user nova-compute[72818]: INFO nova.compute.manager [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Took 8.75 seconds to build instance.
Aug 17 21:20:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9799369-faf3-45c7-ab89-16493e693772 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.861s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "03cea654-4432-45b4-940b-64a55568f35a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "03cea654-4432-45b4-940b-64a55568f35a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "03cea654-4432-45b4-940b-64a55568f35a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "03cea654-4432-45b4-940b-64a55568f35a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "03cea654-4432-45b4-940b-64a55568f35a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:45 user nova-compute[72818]: INFO nova.compute.manager [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Terminating instance
Aug 17 21:20:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-aed6d3f0-a766-4780-97aa-6941b3f913e0 req-3747b385-318c-4c4b-b0e0-edcbac480b9c service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Received event network-vif-unplugged-36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-aed6d3f0-a766-4780-97aa-6941b3f913e0 req-3747b385-318c-4c4b-b0e0-edcbac480b9c service nova] Acquiring lock "03cea654-4432-45b4-940b-64a55568f35a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-aed6d3f0-a766-4780-97aa-6941b3f913e0 req-3747b385-318c-4c4b-b0e0-edcbac480b9c service nova] Lock "03cea654-4432-45b4-940b-64a55568f35a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-aed6d3f0-a766-4780-97aa-6941b3f913e0 req-3747b385-318c-4c4b-b0e0-edcbac480b9c service nova] Lock "03cea654-4432-45b4-940b-64a55568f35a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-aed6d3f0-a766-4780-97aa-6941b3f913e0 req-3747b385-318c-4c4b-b0e0-edcbac480b9c service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] No waiting events found dispatching network-vif-unplugged-36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:20:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-aed6d3f0-a766-4780-97aa-6941b3f913e0 req-3747b385-318c-4c4b-b0e0-edcbac480b9c service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Received event network-vif-unplugged-36c961a2-4391-461c-9726-f2d74f90b3c0 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:20:46 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Instance destroyed successfully.
Aug 17 21:20:46 user nova-compute[72818]: DEBUG nova.objects.instance [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lazy-loading 'resources' on Instance uuid 03cea654-4432-45b4-940b-64a55568f35a {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-979517262',display_name='tempest-VolumesAdminNegativeTest-server-979517262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-979517262',id=14,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f25ddb77be74b0184e1685cd0e34122',ramdisk_id='',reservation_id='r-gg873won',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-342058843',owner_user_name='tempest-VolumesAdminNegativeTest-342058843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:18:48Z,user_data=None,user_id='a882239cd3054ad3abc93fd0b32a70c7',uuid=03cea654-4432-45b4-940b-64a55568f35a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36c961a2-4391-461c-9726-f2d74f90b3c0", "address": "fa:16:3e:17:33:e6", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c961a2-43", "ovs_interfaceid": "36c961a2-4391-461c-9726-f2d74f90b3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Converting VIF {"id": "36c961a2-4391-461c-9726-f2d74f90b3c0", "address": "fa:16:3e:17:33:e6", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c961a2-43", "ovs_interfaceid": "36c961a2-4391-461c-9726-f2d74f90b3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:33:e6,bridge_name='br-int',has_traffic_filtering=True,id=36c961a2-4391-461c-9726-f2d74f90b3c0,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c961a2-43') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG os_vif [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:33:e6,bridge_name='br-int',has_traffic_filtering=True,id=36c961a2-4391-461c-9726-f2d74f90b3c0,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c961a2-43') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36c961a2-43, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:46 user nova-compute[72818]: INFO os_vif [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:33:e6,bridge_name='br-int',has_traffic_filtering=True,id=36c961a2-4391-461c-9726-f2d74f90b3c0,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c961a2-43')
Aug 17 21:20:46 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Deleting instance files /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a_del
Aug 17 21:20:46 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Deletion of /opt/stack/data/nova/instances/03cea654-4432-45b4-940b-64a55568f35a_del complete
Aug 17 21:20:46 user nova-compute[72818]: INFO nova.compute.manager [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 17 21:20:46 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 03cea654-4432-45b4-940b-64a55568f35a] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:20:46 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Took 0.60 seconds to deallocate network for instance.
Aug 17 21:20:46 user nova-compute[72818]: DEBUG nova.compute.manager [req-70048451-be4d-4815-bc7d-5cd5beb0e214 req-12f8a296-a804-4786-98f4-562f7c336fd9 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Received event network-vif-deleted-36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:46 user nova-compute[72818]: INFO nova.compute.manager [req-70048451-be4d-4815-bc7d-5cd5beb0e214 req-12f8a296-a804-4786-98f4-562f7c336fd9 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Neutron deleted interface 36c961a2-4391-461c-9726-f2d74f90b3c0; detaching it from the instance and deleting it from the info cache
Aug 17 21:20:46 user nova-compute[72818]: DEBUG nova.network.neutron [req-70048451-be4d-4815-bc7d-5cd5beb0e214 req-12f8a296-a804-4786-98f4-562f7c336fd9 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG nova.compute.manager [req-70048451-be4d-4815-bc7d-5cd5beb0e214 req-12f8a296-a804-4786-98f4-562f7c336fd9 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Detach interface failed, port_id=36c961a2-4391-461c-9726-f2d74f90b3c0, reason: Instance 03cea654-4432-45b4-940b-64a55568f35a could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:47 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:20:47 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:20:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:47 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Deleted allocations for instance 03cea654-4432-45b4-940b-64a55568f35a
Aug 17 21:20:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26e279de-230e-4c5a-b0db-2cbfc94f4777 tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "03cea654-4432-45b4-940b-64a55568f35a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.344s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-20b8b9e0-ba47-4c15-9682-16c225c8bb33 req-23614552-bfd9-4f8b-b5aa-55045f573fd7 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Received event network-vif-plugged-36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-20b8b9e0-ba47-4c15-9682-16c225c8bb33 req-23614552-bfd9-4f8b-b5aa-55045f573fd7 service nova] Acquiring lock "03cea654-4432-45b4-940b-64a55568f35a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-20b8b9e0-ba47-4c15-9682-16c225c8bb33 req-23614552-bfd9-4f8b-b5aa-55045f573fd7 service nova] Lock "03cea654-4432-45b4-940b-64a55568f35a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-20b8b9e0-ba47-4c15-9682-16c225c8bb33 req-23614552-bfd9-4f8b-b5aa-55045f573fd7 service nova] Lock "03cea654-4432-45b4-940b-64a55568f35a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-20b8b9e0-ba47-4c15-9682-16c225c8bb33 req-23614552-bfd9-4f8b-b5aa-55045f573fd7 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] No waiting events found dispatching network-vif-plugged-36c961a2-4391-461c-9726-f2d74f90b3c0 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:20:48 user nova-compute[72818]: WARNING nova.compute.manager [req-20b8b9e0-ba47-4c15-9682-16c225c8bb33 req-23614552-bfd9-4f8b-b5aa-55045f573fd7 service nova] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Received unexpected event network-vif-plugged-36c961a2-4391-461c-9726-f2d74f90b3c0 for instance with vm_state deleted and task_state None.
Aug 17 21:20:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:49 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:49 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:20:49 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:20:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:20:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:20:49 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:20:49 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid b9a0da7f-47b4-467f-944d-49adac671a06 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:20:50 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Updating instance_info_cache with network_info: [{"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:20:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:20:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:20:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:51 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:51 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:51 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 21:20:51 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] There are 0 instances to clean {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 21:20:52 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:52 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72818) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 21:20:53 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:53 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:20:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:54 user nova-compute[72818]: INFO nova.compute.manager [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Detaching volume 2f22705a-c01e-47fd-ada8-bfc45b2f52d8
Aug 17 21:20:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:54 user nova-compute[72818]: INFO nova.virt.block_device [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Attempting to driver detach volume 2f22705a-c01e-47fd-ada8-bfc45b2f52d8 from mountpoint /dev/vdb
Aug 17 21:20:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Attempting to detach device vdb from instance b4a54471-2c50-435f-8e78-e5cdd1b41093 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:20:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:20:54 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:20:54 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:20:54 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:20:54 user nova-compute[72818]:   <serial>2f22705a-c01e-47fd-ada8-bfc45b2f52d8</serial>
Aug 17 21:20:54 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:20:54 user nova-compute[72818]: </disk>
Aug 17 21:20:54 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:20:54 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Successfully detached device vdb from instance b4a54471-2c50-435f-8e78-e5cdd1b41093 from the persistent domain config.
Aug 17 21:20:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b4a54471-2c50-435f-8e78-e5cdd1b41093 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:20:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:20:54 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:20:54 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:20:54 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:20:54 user nova-compute[72818]:   <serial>2f22705a-c01e-47fd-ada8-bfc45b2f52d8</serial>
Aug 17 21:20:54 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:20:54 user nova-compute[72818]: </disk>
Aug 17 21:20:54 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:20:54 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:54 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:20:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:54 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692307255.206129, b4a54471-2c50-435f-8e78-e5cdd1b41093 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b4a54471-2c50-435f-8e78-e5cdd1b41093 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:20:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Successfully detached device vdb from instance b4a54471-2c50-435f-8e78-e5cdd1b41093 from the live domain config.
Aug 17 21:20:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XSHWdrCk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:20:55 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5e8957-4e40-44fe-a334-bd5fd89ddd66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[629e7fcc-a89a-4e38-a0b2-21323b00f009]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:20:55 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:20:55 user nova-compute[72818]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 (non-flash)
Aug 17 21:20:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:20:55 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:20:55 user nova-compute[72818]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 (non-flash)
Aug 17 21:20:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04dfc0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d5a0bc-05e6-48af-a4fb-c66c1f92bc58]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c3a31a-dc3c-4e96-b185-250a31419a99]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aca32f9-eb48-42b5-a190-d8c83caa2b22]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41204cb-67b7-4940-8fa5-d28fa9f5f35d]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf662a9-a3b8-4851-bf8f-4146ba44a9de]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[24673469-757b-4f0e-8329-494f88d08092]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8, portal: 172.16.0.220,3260]
Aug 17 21:20:55 user nova-compute[72818]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8, portal: 172.16.0.220,3260] successful.
Aug 17 21:20:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acffe5c-3bfd-489a-919b-3bb051875872]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] <== disconnect_volume: return (403ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lazy-loading 'flavor' on Instance uuid b4a54471-2c50-435f-8e78-e5cdd1b41093 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f06e30cf-6736-4aaf-9e71-a5ab6ba99d5b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.019s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.907s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:56 user nova-compute[72818]: INFO nova.compute.manager [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Terminating instance
Aug 17 21:20:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG nova.compute.manager [req-42b21be1-39c0-4f20-aee2-45d106f4bc58 req-cf64797a-b3a5-463b-b3ed-09a68eb5f962 service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Received event network-vif-unplugged-736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-42b21be1-39c0-4f20-aee2-45d106f4bc58 req-cf64797a-b3a5-463b-b3ed-09a68eb5f962 service nova] Acquiring lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-42b21be1-39c0-4f20-aee2-45d106f4bc58 req-cf64797a-b3a5-463b-b3ed-09a68eb5f962 service nova] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-42b21be1-39c0-4f20-aee2-45d106f4bc58 req-cf64797a-b3a5-463b-b3ed-09a68eb5f962 service nova] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG nova.compute.manager [req-42b21be1-39c0-4f20-aee2-45d106f4bc58 req-cf64797a-b3a5-463b-b3ed-09a68eb5f962 service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] No waiting events found dispatching network-vif-unplugged-736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG nova.compute.manager [req-42b21be1-39c0-4f20-aee2-45d106f4bc58 req-cf64797a-b3a5-463b-b3ed-09a68eb5f962 service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Received event network-vif-unplugged-736f010d-ebe7-49fc-846d-1e12845ecb81 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Instance destroyed successfully.
Aug 17 21:20:57 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lazy-loading 'resources' on Instance uuid b4a54471-2c50-435f-8e78-e5cdd1b41093 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:17:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-778019218',display_name='tempest-VolumesSnapshotTestJSON-instance-778019218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-778019218',id=12,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqeHsIbDwZLoNy36zYEst+y94zqRdY0yIyWVAqU8lLu9W7cpN6M+1E78gHlV72uDTZ7RjxU01jOH4sozk4TeLYphkBgk8QQQ6oCpATOy5aSW9KIp6PeivBA3b9kbUQV4A==',key_name='tempest-keypair-1313671370',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:18:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3427d284fd1446f8b7144adeef980549',ramdisk_id='',reservation_id='r-hr9u84yx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-473153764',owner_user_name='tempest-VolumesSnapshotTestJSON-473153764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44662762d7924c16aaa0dfa5c38e5983',uuid=b4a54471-2c50-435f-8e78-e5cdd1b41093,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "736f010d-ebe7-49fc-846d-1e12845ecb81", "address": "fa:16:3e:71:ff:2d", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736f010d-eb", "ovs_interfaceid": "736f010d-ebe7-49fc-846d-1e12845ecb81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Converting VIF {"id": "736f010d-ebe7-49fc-846d-1e12845ecb81", "address": "fa:16:3e:71:ff:2d", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736f010d-eb", "ovs_interfaceid": "736f010d-ebe7-49fc-846d-1e12845ecb81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:ff:2d,bridge_name='br-int',has_traffic_filtering=True,id=736f010d-ebe7-49fc-846d-1e12845ecb81,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736f010d-eb') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG os_vif [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ff:2d,bridge_name='br-int',has_traffic_filtering=True,id=736f010d-ebe7-49fc-846d-1e12845ecb81,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736f010d-eb') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap736f010d-eb, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:20:57 user nova-compute[72818]: INFO os_vif [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ff:2d,bridge_name='br-int',has_traffic_filtering=True,id=736f010d-ebe7-49fc-846d-1e12845ecb81,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736f010d-eb')
Aug 17 21:20:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XSHWdrCk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:20:57 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:20:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f22705a-c01e-47fd-ada8-bfc45b2f52d8', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2536c8-f34f-4ec9-a740-7420a7b7ca1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f58510-eabc-4877-a61a-249761f65df8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:20:57 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:20:57 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:20:57 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:20:57 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04f23ac0>, {}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Disconnecting from: [] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] <== disconnect_volume: return (96ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:20:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Deleting instance files /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093_del
Aug 17 21:20:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Deletion of /opt/stack/data/nova/instances/b4a54471-2c50-435f-8e78-e5cdd1b41093_del complete
Aug 17 21:20:57 user nova-compute[72818]: INFO nova.compute.manager [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:58 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid 'b4a54471-2c50-435f-8e78-e5cdd1b41093' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b4a54471-2c50-435f-8e78-e5cdd1b41093' (instance-0000000c)
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:20:58 user nova-compute[72818]: INFO nova.compute.claims [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Claim successful on node user
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Refreshing inventories for resource provider d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Updating ProviderTree inventory for provider d156e3af-684d-47e1-a951-585f9c95fa46 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-e0f82c54-07bc-4b6d-8ac7-c418c5090880 req-35a7ac8e-12ee-46cd-bffc-13c0b774bc7f service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Received event network-vif-deleted-736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:58 user nova-compute[72818]: INFO nova.compute.manager [req-e0f82c54-07bc-4b6d-8ac7-c418c5090880 req-35a7ac8e-12ee-46cd-bffc-13c0b774bc7f service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Neutron deleted interface 736f010d-ebe7-49fc-846d-1e12845ecb81; detaching it from the instance and deleting it from the info cache
Aug 17 21:20:58 user nova-compute[72818]: DEBUG nova.network.neutron [req-e0f82c54-07bc-4b6d-8ac7-c418c5090880 req-35a7ac8e-12ee-46cd-bffc-13c0b774bc7f service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:20:58 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Took 1.18 seconds to deallocate network for instance.
Aug 17 21:20:58 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Refreshing aggregate associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, aggregates: None {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-e0f82c54-07bc-4b6d-8ac7-c418c5090880 req-35a7ac8e-12ee-46cd-bffc-13c0b774bc7f service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Detach interface failed, port_id=736f010d-ebe7-49fc-846d-1e12845ecb81, reason: Instance b4a54471-2c50-435f-8e78-e5cdd1b41093 could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:20:58 user nova-compute[72818]: WARNING nova.volume.cinder [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Attachment a1f1447e-90f2-4a80-8dbd-7d52051d6f29 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a1f1447e-90f2-4a80-8dbd-7d52051d6f29. (HTTP 404) (Request-ID: req-c27be608-cd1f-4734-9096-70dbf6f009d1)
Aug 17 21:20:58 user nova-compute[72818]: INFO nova.compute.manager [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Took 0.03 seconds to detach 1 volumes for instance.
Aug 17 21:20:58 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Refreshing trait associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-248cfcf2-602b-4cb2-a67c-f625bb0e211f req-317ceab6-c4f1-463a-a98e-752917efbddd service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Received event network-vif-plugged-736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-248cfcf2-602b-4cb2-a67c-f625bb0e211f req-317ceab6-c4f1-463a-a98e-752917efbddd service nova] Acquiring lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-248cfcf2-602b-4cb2-a67c-f625bb0e211f req-317ceab6-c4f1-463a-a98e-752917efbddd service nova] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-248cfcf2-602b-4cb2-a67c-f625bb0e211f req-317ceab6-c4f1-463a-a98e-752917efbddd service nova] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-248cfcf2-602b-4cb2-a67c-f625bb0e211f req-317ceab6-c4f1-463a-a98e-752917efbddd service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] No waiting events found dispatching network-vif-plugged-736f010d-ebe7-49fc-846d-1e12845ecb81 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:20:59 user nova-compute[72818]: WARNING nova.compute.manager [req-248cfcf2-602b-4cb2-a67c-f625bb0e211f req-317ceab6-c4f1-463a-a98e-752917efbddd service nova] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Received unexpected event network-vif-plugged-736f010d-ebe7-49fc-846d-1e12845ecb81 for instance with vm_state deleted and task_state None.
Aug 17 21:20:59 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.784s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.369s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:20:59 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:20:59 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:20:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.policy [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '721ba7982e32474aa2516493125fbf18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885c25f7a170493480c909f74b2188d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:21:00 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Creating image(s)
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "/opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "/opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "/opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:00 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:21:00 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7034MB free_disk=25.35171127319336GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.935s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.235s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:00 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Deleted allocations for instance b4a54471-2c50-435f-8e78-e5cdd1b41093
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8df20a8f-383b-4a28-9214-60347ff80536 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "b4a54471-2c50-435f-8e78-e5cdd1b41093" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.847s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk 1073741824" returned: 0 in 0.065s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b93c6b2f-59ee-4e7f-9805-97ef627eccdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e8b5ccab-5dff-4458-a799-8c8528a032b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance be9e52eb-e0db-4b00-aa69-b8506b2275fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 774642dc-1888-4f4e-9485-b6dfe7ad6a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Cannot resize image /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lazy-loading 'migration_context' on Instance uuid 774642dc-1888-4f4e-9485-b6dfe7ad6a7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Ensure instance console log exists: /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Successfully created port: 3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:21:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:01 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307246.0482256, 03cea654-4432-45b4-940b-64a55568f35a => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:21:01 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 03cea654-4432-45b4-940b-64a55568f35a] VM Stopped (Lifecycle Event)
Aug 17 21:21:01 user nova-compute[72818]: DEBUG nova.compute.manager [None req-54718bb8-f356-4ae4-9744-03601ac7420e None None] [instance: 03cea654-4432-45b4-940b-64a55568f35a] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:21:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:01 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Successfully updated port: 3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:21:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "refresh_cache-774642dc-1888-4f4e-9485-b6dfe7ad6a7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:21:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquired lock "refresh_cache-774642dc-1888-4f4e-9485-b6dfe7ad6a7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:21:01 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:21:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-add28743-b31a-4cdd-96c8-ceab50f536c0 req-a67dfaff-14f1-4ed0-9409-f43d8b9bd63a service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Received event network-changed-3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-add28743-b31a-4cdd-96c8-ceab50f536c0 req-a67dfaff-14f1-4ed0-9409-f43d8b9bd63a service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Refreshing instance network info cache due to event network-changed-3fd414a9-7626-492c-8040-bc696ba6b8d6. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:21:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-add28743-b31a-4cdd-96c8-ceab50f536c0 req-a67dfaff-14f1-4ed0-9409-f43d8b9bd63a service nova] Acquiring lock "refresh_cache-774642dc-1888-4f4e-9485-b6dfe7ad6a7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:21:01 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:21:01 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Updating instance_info_cache with network_info: [{"id": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "address": "fa:16:3e:32:9a:3b", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd414a9-76", "ovs_interfaceid": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Releasing lock "refresh_cache-774642dc-1888-4f4e-9485-b6dfe7ad6a7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Instance network_info: |[{"id": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "address": "fa:16:3e:32:9a:3b", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd414a9-76", "ovs_interfaceid": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-add28743-b31a-4cdd-96c8-ceab50f536c0 req-a67dfaff-14f1-4ed0-9409-f43d8b9bd63a service nova] Acquired lock "refresh_cache-774642dc-1888-4f4e-9485-b6dfe7ad6a7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.network.neutron [req-add28743-b31a-4cdd-96c8-ceab50f536c0 req-a67dfaff-14f1-4ed0-9409-f43d8b9bd63a service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Refreshing network info cache for port 3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Start _get_guest_xml network_info=[{"id": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "address": "fa:16:3e:32:9a:3b", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd414a9-76", "ovs_interfaceid": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:21:02 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:21:02 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2031178523',display_name='tempest-ServersNegativeTestJSON-server-2031178523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2031178523',id=19,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='885c25f7a170493480c909f74b2188d1',ramdisk_id='',reservation_id='r-dawk7omz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1481471081',owner_user_name='tempest-ServersNegativeTestJSON-1481471081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:21:00Z,user_data=None,user_id='721ba7982e32474aa2516493125fbf18',uuid=774642dc-1888-4f4e-9485-b6dfe7ad6a7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "address": "fa:16:3e:32:9a:3b", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd414a9-76", "ovs_interfaceid": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Converting VIF {"id": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "address": "fa:16:3e:32:9a:3b", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd414a9-76", "ovs_interfaceid": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:9a:3b,bridge_name='br-int',has_traffic_filtering=True,id=3fd414a9-7626-492c-8040-bc696ba6b8d6,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd414a9-76') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lazy-loading 'pci_devices' on Instance uuid 774642dc-1888-4f4e-9485-b6dfe7ad6a7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:21:02 user nova-compute[72818]:   <uuid>774642dc-1888-4f4e-9485-b6dfe7ad6a7f</uuid>
Aug 17 21:21:02 user nova-compute[72818]:   <name>instance-00000013</name>
Aug 17 21:21:02 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:21:02 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:21:02 user nova-compute[72818]:   <metadata>
Aug 17 21:21:02 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:21:02 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:21:02 user nova-compute[72818]:       <nova:name>tempest-ServersNegativeTestJSON-server-2031178523</nova:name>
Aug 17 21:21:02 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:21:02</nova:creationTime>
Aug 17 21:21:02 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:21:02 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:21:02 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:21:02 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:21:02 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:21:02 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:21:02 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:21:02 user nova-compute[72818]:       <nova:owner>
Aug 17 21:21:02 user nova-compute[72818]:         <nova:user uuid="721ba7982e32474aa2516493125fbf18">tempest-ServersNegativeTestJSON-1481471081-project-member</nova:user>
Aug 17 21:21:02 user nova-compute[72818]:         <nova:project uuid="885c25f7a170493480c909f74b2188d1">tempest-ServersNegativeTestJSON-1481471081</nova:project>
Aug 17 21:21:02 user nova-compute[72818]:       </nova:owner>
Aug 17 21:21:02 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:21:02 user nova-compute[72818]:       <nova:ports>
Aug 17 21:21:02 user nova-compute[72818]:         <nova:port uuid="3fd414a9-7626-492c-8040-bc696ba6b8d6">
Aug 17 21:21:02 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 21:21:02 user nova-compute[72818]:         </nova:port>
Aug 17 21:21:02 user nova-compute[72818]:       </nova:ports>
Aug 17 21:21:02 user nova-compute[72818]:     </nova:instance>
Aug 17 21:21:02 user nova-compute[72818]:   </metadata>
Aug 17 21:21:02 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:21:02 user nova-compute[72818]:     <system>
Aug 17 21:21:02 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:21:02 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:21:02 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:21:02 user nova-compute[72818]:       <entry name="serial">774642dc-1888-4f4e-9485-b6dfe7ad6a7f</entry>
Aug 17 21:21:02 user nova-compute[72818]:       <entry name="uuid">774642dc-1888-4f4e-9485-b6dfe7ad6a7f</entry>
Aug 17 21:21:02 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:21:02 user nova-compute[72818]:     </system>
Aug 17 21:21:02 user nova-compute[72818]:   </sysinfo>
Aug 17 21:21:02 user nova-compute[72818]:   <os>
Aug 17 21:21:02 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:21:02 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:21:02 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:21:02 user nova-compute[72818]:   </os>
Aug 17 21:21:02 user nova-compute[72818]:   <features>
Aug 17 21:21:02 user nova-compute[72818]:     <acpi/>
Aug 17 21:21:02 user nova-compute[72818]:     <apic/>
Aug 17 21:21:02 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:21:02 user nova-compute[72818]:   </features>
Aug 17 21:21:02 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:21:02 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:21:02 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:21:02 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:21:02 user nova-compute[72818]:   </clock>
Aug 17 21:21:02 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:21:02 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:21:02 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:21:02 user nova-compute[72818]:   </cpu>
Aug 17 21:21:02 user nova-compute[72818]:   <devices>
Aug 17 21:21:02 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:21:02 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:21:02 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk"/>
Aug 17 21:21:02 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:21:02 user nova-compute[72818]:     </disk>
Aug 17 21:21:02 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:21:02 user nova-compute[72818]:       <mac address="fa:16:3e:32:9a:3b"/>
Aug 17 21:21:02 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:21:02 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:21:02 user nova-compute[72818]:       <target dev="tap3fd414a9-76"/>
Aug 17 21:21:02 user nova-compute[72818]:     </interface>
Aug 17 21:21:02 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:21:02 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/console.log" append="off"/>
Aug 17 21:21:02 user nova-compute[72818]:     </serial>
Aug 17 21:21:02 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:21:02 user nova-compute[72818]:     <video>
Aug 17 21:21:02 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:21:02 user nova-compute[72818]:     </video>
Aug 17 21:21:02 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:21:02 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:21:02 user nova-compute[72818]:     </rng>
Aug 17 21:21:02 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:21:02 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:21:02 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:21:02 user nova-compute[72818]:     </memballoon>
Aug 17 21:21:02 user nova-compute[72818]:   </devices>
Aug 17 21:21:02 user nova-compute[72818]: </domain>
Aug 17 21:21:02 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2031178523',display_name='tempest-ServersNegativeTestJSON-server-2031178523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2031178523',id=19,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='885c25f7a170493480c909f74b2188d1',ramdisk_id='',reservation_id='r-dawk7omz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1481471081',owner_user_name='tempest-ServersNegativeTestJSON-1481471081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:21:00Z,user_data=None,user_id='721ba7982e32474aa2516493125fbf18',uuid=774642dc-1888-4f4e-9485-b6dfe7ad6a7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "address": "fa:16:3e:32:9a:3b", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd414a9-76", "ovs_interfaceid": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Converting VIF {"id": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "address": "fa:16:3e:32:9a:3b", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd414a9-76", "ovs_interfaceid": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:9a:3b,bridge_name='br-int',has_traffic_filtering=True,id=3fd414a9-7626-492c-8040-bc696ba6b8d6,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd414a9-76') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG os_vif [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:9a:3b,bridge_name='br-int',has_traffic_filtering=True,id=3fd414a9-7626-492c-8040-bc696ba6b8d6,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd414a9-76') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fd414a9-76, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fd414a9-76, col_values=(('external_ids', {'iface-id': '3fd414a9-7626-492c-8040-bc696ba6b8d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:9a:3b', 'vm-uuid': '774642dc-1888-4f4e-9485-b6dfe7ad6a7f'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:02 user nova-compute[72818]: INFO os_vif [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:9a:3b,bridge_name='br-int',has_traffic_filtering=True,id=3fd414a9-7626-492c-8040-bc696ba6b8d6,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd414a9-76')
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] No VIF found with MAC fa:16:3e:32:9a:3b, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.network.neutron [req-add28743-b31a-4cdd-96c8-ceab50f536c0 req-a67dfaff-14f1-4ed0-9409-f43d8b9bd63a service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Updated VIF entry in instance network info cache for port 3fd414a9-7626-492c-8040-bc696ba6b8d6. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG nova.network.neutron [req-add28743-b31a-4cdd-96c8-ceab50f536c0 req-a67dfaff-14f1-4ed0-9409-f43d8b9bd63a service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Updating instance_info_cache with network_info: [{"id": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "address": "fa:16:3e:32:9a:3b", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd414a9-76", "ovs_interfaceid": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:21:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-add28743-b31a-4cdd-96c8-ceab50f536c0 req-a67dfaff-14f1-4ed0-9409-f43d8b9bd63a service nova] Releasing lock "refresh_cache-774642dc-1888-4f4e-9485-b6dfe7ad6a7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:21:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-7dcd1a20-e984-4859-95e5-c1a354f8a26d req-27a74eab-45d5-4013-aa23-2bb451468b74 service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Received event network-vif-plugged-3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7dcd1a20-e984-4859-95e5-c1a354f8a26d req-27a74eab-45d5-4013-aa23-2bb451468b74 service nova] Acquiring lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7dcd1a20-e984-4859-95e5-c1a354f8a26d req-27a74eab-45d5-4013-aa23-2bb451468b74 service nova] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7dcd1a20-e984-4859-95e5-c1a354f8a26d req-27a74eab-45d5-4013-aa23-2bb451468b74 service nova] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-7dcd1a20-e984-4859-95e5-c1a354f8a26d req-27a74eab-45d5-4013-aa23-2bb451468b74 service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] No waiting events found dispatching network-vif-plugged-3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:03 user nova-compute[72818]: WARNING nova.compute.manager [req-7dcd1a20-e984-4859-95e5-c1a354f8a26d req-27a74eab-45d5-4013-aa23-2bb451468b74 service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Received unexpected event network-vif-plugged-3fd414a9-7626-492c-8040-bc696ba6b8d6 for instance with vm_state building and task_state spawning.
Aug 17 21:21:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307265.7270179, 774642dc-1888-4f4e-9485-b6dfe7ad6a7f => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:21:05 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] VM Resumed (Lifecycle Event)
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:21:05 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Instance spawned successfully.
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:21:05 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307265.7290146, 774642dc-1888-4f4e-9485-b6dfe7ad6a7f => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:21:05 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] VM Started (Lifecycle Event)
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:21:05 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:21:05 user nova-compute[72818]: INFO nova.compute.manager [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 17 21:21:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:21:05 user nova-compute[72818]: INFO nova.compute.manager [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Took 7.52 seconds to build instance.
Aug 17 21:21:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed020c34-159b-4365-9ae8-e027c1ba8e4b tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.629s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-48218efd-d03e-4e36-b6bd-940579b9add3 req-4440581f-5cd5-413d-8c46-af48c91d8f2a service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Received event network-vif-plugged-3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-48218efd-d03e-4e36-b6bd-940579b9add3 req-4440581f-5cd5-413d-8c46-af48c91d8f2a service nova] Acquiring lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-48218efd-d03e-4e36-b6bd-940579b9add3 req-4440581f-5cd5-413d-8c46-af48c91d8f2a service nova] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-48218efd-d03e-4e36-b6bd-940579b9add3 req-4440581f-5cd5-413d-8c46-af48c91d8f2a service nova] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-48218efd-d03e-4e36-b6bd-940579b9add3 req-4440581f-5cd5-413d-8c46-af48c91d8f2a service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] No waiting events found dispatching network-vif-plugged-3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:06 user nova-compute[72818]: WARNING nova.compute.manager [req-48218efd-d03e-4e36-b6bd-940579b9add3 req-4440581f-5cd5-413d-8c46-af48c91d8f2a service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Received unexpected event network-vif-plugged-3fd414a9-7626-492c-8040-bc696ba6b8d6 for instance with vm_state active and task_state None.
Aug 17 21:21:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:07 user nova-compute[72818]: INFO nova.compute.manager [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Detaching volume 24964e89-33fc-4294-8db4-9db93143d744
Aug 17 21:21:07 user nova-compute[72818]: INFO nova.virt.block_device [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Attempting to driver detach volume 24964e89-33fc-4294-8db4-9db93143d744 from mountpoint /dev/vdb
Aug 17 21:21:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Attempting to detach device vdb from instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:21:08 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:21:08 user nova-compute[72818]:   <source dev="/dev/sdi"/>
Aug 17 21:21:08 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:21:08 user nova-compute[72818]:   <serial>24964e89-33fc-4294-8db4-9db93143d744</serial>
Aug 17 21:21:08 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:21:08 user nova-compute[72818]: </disk>
Aug 17 21:21:08 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:21:08 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Successfully detached device vdb from instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532 from the persistent domain config.
Aug 17 21:21:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:21:08 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:21:08 user nova-compute[72818]:   <source dev="/dev/sdi"/>
Aug 17 21:21:08 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:21:08 user nova-compute[72818]:   <serial>24964e89-33fc-4294-8db4-9db93143d744</serial>
Aug 17 21:21:08 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:21:08 user nova-compute[72818]: </disk>
Aug 17 21:21:08 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692307268.485836, 01fcc357-dc4c-4215-b3a5-b9cea51ed532 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:21:08 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Successfully detached device vdb from instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532 from the live domain config.
Aug 17 21:21:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EoNGhWKB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:21:08 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f9227f-9efe-4cbc-abc6-855e6c1f7022]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecae030-c3a5-4b79-a562-9a1f72f6e718]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:21:08 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:21:08 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 (non-flash)
Aug 17 21:21:08 user nova-compute[72818]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:21:08 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f28591750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744'): ({'sdi'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Removing single pathed devices sdi {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de009c8-9232-4862-95da-c770f3063930]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5077c7-7dbb-43ec-88a6-95b3b3be2732]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Flushing IO for device /dev/sdi {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2229c3-d879-462d-9240-1ac4e9f68556]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e2787-ba15-483e-bf22-9ad899a214d1]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] SCSI volumes sdi have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d48bd0-3465-4d9a-a766-1a0a66770dcc]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[010b9fc8-5cf6-4450-84da-a0ae288a3906]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744, portal: 172.16.0.220,3260]
Aug 17 21:21:08 user nova-compute[72818]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744, portal: 172.16.0.220,3260] successful.
Aug 17 21:21:08 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24964e89-33fc-4294-8db4-9db93143d744 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25a1052-c627-4c42-9848-07ba927c34fc]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] <== disconnect_volume: return (288ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:21:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:21:09 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lazy-loading 'flavor' on Instance uuid 01fcc357-dc4c-4215-b3a5-b9cea51ed532 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:21:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d78a3729-663d-4345-bfdd-8aecc2e56188 tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.874s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:12 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307257.4245067, b4a54471-2c50-435f-8e78-e5cdd1b41093 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:21:12 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] VM Stopped (Lifecycle Event)
Aug 17 21:21:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c8e736e8-b890-4a86-809d-8a82afeed519 None None] [instance: b4a54471-2c50-435f-8e78-e5cdd1b41093] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:21:13 user nova-compute[72818]: INFO nova.compute.manager [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Rescuing
Aug 17 21:21:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:21:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquired lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:21:13 user nova-compute[72818]: DEBUG nova.network.neutron [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:21:14 user nova-compute[72818]: DEBUG nova.network.neutron [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Updating instance_info_cache with network_info: [{"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:21:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Releasing lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:21:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Instance destroyed successfully.
Aug 17 21:21:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Attempting rescue
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72818) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Instance directory exists: not creating {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 21:21:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Creating image(s)
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "/opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "/opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "/opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'trusted_certs' on Instance uuid 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-9514e900-b8e5-4047-a3c7-16e0a41b7367 req-0c111250-0a67-4967-a8e4-dbaab9e71a5a service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-unplugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9514e900-b8e5-4047-a3c7-16e0a41b7367 req-0c111250-0a67-4967-a8e4-dbaab9e71a5a service nova] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9514e900-b8e5-4047-a3c7-16e0a41b7367 req-0c111250-0a67-4967-a8e4-dbaab9e71a5a service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9514e900-b8e5-4047-a3c7-16e0a41b7367 req-0c111250-0a67-4967-a8e4-dbaab9e71a5a service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-9514e900-b8e5-4047-a3c7-16e0a41b7367 req-0c111250-0a67-4967-a8e4-dbaab9e71a5a service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] No waiting events found dispatching network-vif-unplugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:15 user nova-compute[72818]: WARNING nova.compute.manager [req-9514e900-b8e5-4047-a3c7-16e0a41b7367 req-0c111250-0a67-4967-a8e4-dbaab9e71a5a service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received unexpected event network-vif-unplugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 for instance with vm_state active and task_state rescuing.
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue" returned: 0 in 0.049s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'migration_context' on Instance uuid 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Start _get_guest_xml network_info=[{"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "vif_mac": "fa:16:3e:ed:bf:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'resources' on Instance uuid 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'numa_topology' on Instance uuid 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:21:15 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:21:15 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'vcpu_model' on Instance uuid 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-141122876',display_name='tempest-ServerRescueNegativeTestJSON-server-141122876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-141122876',id=16,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f6bdddb43364e86b302c9c2e273fd44',ramdisk_id='',reservation_id='r-maezm2id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-713886303',owner_user_name='tempest-ServerRescueNegativeTestJSON-713886303-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:19:32Z,user_data=None,user_id='8ffa40080d9842b1a4f6a3e041b5d123',uuid=94abd430-6fc8-4c31-9dc8-c44df16ed4a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "vif_mac": "fa:16:3e:ed:bf:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converting VIF {"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "vif_mac": "fa:16:3e:ed:bf:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:bf:34,bridge_name='br-int',has_traffic_filtering=True,id=c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37ec1f4-f3') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'pci_devices' on Instance uuid 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:21:15 user nova-compute[72818]:   <uuid>94abd430-6fc8-4c31-9dc8-c44df16ed4a3</uuid>
Aug 17 21:21:15 user nova-compute[72818]:   <name>instance-00000010</name>
Aug 17 21:21:15 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:21:15 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:21:15 user nova-compute[72818]:   <metadata>
Aug 17 21:21:15 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:21:15 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:21:15 user nova-compute[72818]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-141122876</nova:name>
Aug 17 21:21:15 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:21:15</nova:creationTime>
Aug 17 21:21:15 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:21:15 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:21:15 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:21:15 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:21:15 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:21:15 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:21:15 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:21:15 user nova-compute[72818]:       <nova:owner>
Aug 17 21:21:15 user nova-compute[72818]:         <nova:user uuid="8ffa40080d9842b1a4f6a3e041b5d123">tempest-ServerRescueNegativeTestJSON-713886303-project-member</nova:user>
Aug 17 21:21:15 user nova-compute[72818]:         <nova:project uuid="7f6bdddb43364e86b302c9c2e273fd44">tempest-ServerRescueNegativeTestJSON-713886303</nova:project>
Aug 17 21:21:15 user nova-compute[72818]:       </nova:owner>
Aug 17 21:21:15 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:21:15 user nova-compute[72818]:       <nova:ports>
Aug 17 21:21:15 user nova-compute[72818]:         <nova:port uuid="c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5">
Aug 17 21:21:15 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 21:21:15 user nova-compute[72818]:         </nova:port>
Aug 17 21:21:15 user nova-compute[72818]:       </nova:ports>
Aug 17 21:21:15 user nova-compute[72818]:     </nova:instance>
Aug 17 21:21:15 user nova-compute[72818]:   </metadata>
Aug 17 21:21:15 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:21:15 user nova-compute[72818]:     <system>
Aug 17 21:21:15 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:21:15 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:21:15 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:21:15 user nova-compute[72818]:       <entry name="serial">94abd430-6fc8-4c31-9dc8-c44df16ed4a3</entry>
Aug 17 21:21:15 user nova-compute[72818]:       <entry name="uuid">94abd430-6fc8-4c31-9dc8-c44df16ed4a3</entry>
Aug 17 21:21:15 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:21:15 user nova-compute[72818]:     </system>
Aug 17 21:21:15 user nova-compute[72818]:   </sysinfo>
Aug 17 21:21:15 user nova-compute[72818]:   <os>
Aug 17 21:21:15 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:21:15 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:21:15 user nova-compute[72818]:   </os>
Aug 17 21:21:15 user nova-compute[72818]:   <features>
Aug 17 21:21:15 user nova-compute[72818]:     <acpi/>
Aug 17 21:21:15 user nova-compute[72818]:     <apic/>
Aug 17 21:21:15 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:21:15 user nova-compute[72818]:   </features>
Aug 17 21:21:15 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:21:15 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:21:15 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:21:15 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:21:15 user nova-compute[72818]:   </clock>
Aug 17 21:21:15 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:21:15 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:21:15 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:21:15 user nova-compute[72818]:   </cpu>
Aug 17 21:21:15 user nova-compute[72818]:   <devices>
Aug 17 21:21:15 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:21:15 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:21:15 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue"/>
Aug 17 21:21:15 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:21:15 user nova-compute[72818]:     </disk>
Aug 17 21:21:15 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:21:15 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:21:15 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk"/>
Aug 17 21:21:15 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:21:15 user nova-compute[72818]:     </disk>
Aug 17 21:21:15 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:21:15 user nova-compute[72818]:       <mac address="fa:16:3e:ed:bf:34"/>
Aug 17 21:21:15 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:21:15 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:21:15 user nova-compute[72818]:       <target dev="tapc37ec1f4-f3"/>
Aug 17 21:21:15 user nova-compute[72818]:     </interface>
Aug 17 21:21:15 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:21:15 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/console.log" append="off"/>
Aug 17 21:21:15 user nova-compute[72818]:     </serial>
Aug 17 21:21:15 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:21:15 user nova-compute[72818]:     <video>
Aug 17 21:21:15 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:21:15 user nova-compute[72818]:     </video>
Aug 17 21:21:15 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:21:15 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:21:15 user nova-compute[72818]:     </rng>
Aug 17 21:21:15 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:21:15 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:21:15 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:21:15 user nova-compute[72818]:     </memballoon>
Aug 17 21:21:15 user nova-compute[72818]:   </devices>
Aug 17 21:21:15 user nova-compute[72818]: </domain>
Aug 17 21:21:15 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:21:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Instance destroyed successfully.
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:21:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No VIF found with MAC fa:16:3e:ed:bf:34, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:21:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-6f37af28-15a6-4916-aad0-bb70d735c935 req-57d333e1-fb60-40c3-8814-aae97537ed98 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6f37af28-15a6-4916-aad0-bb70d735c935 req-57d333e1-fb60-40c3-8814-aae97537ed98 service nova] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6f37af28-15a6-4916-aad0-bb70d735c935 req-57d333e1-fb60-40c3-8814-aae97537ed98 service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6f37af28-15a6-4916-aad0-bb70d735c935 req-57d333e1-fb60-40c3-8814-aae97537ed98 service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-6f37af28-15a6-4916-aad0-bb70d735c935 req-57d333e1-fb60-40c3-8814-aae97537ed98 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] No waiting events found dispatching network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:17 user nova-compute[72818]: WARNING nova.compute.manager [req-6f37af28-15a6-4916-aad0-bb70d735c935 req-57d333e1-fb60-40c3-8814-aae97537ed98 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received unexpected event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 for instance with vm_state active and task_state rescuing.
Aug 17 21:21:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-6f37af28-15a6-4916-aad0-bb70d735c935 req-57d333e1-fb60-40c3-8814-aae97537ed98 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6f37af28-15a6-4916-aad0-bb70d735c935 req-57d333e1-fb60-40c3-8814-aae97537ed98 service nova] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6f37af28-15a6-4916-aad0-bb70d735c935 req-57d333e1-fb60-40c3-8814-aae97537ed98 service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6f37af28-15a6-4916-aad0-bb70d735c935 req-57d333e1-fb60-40c3-8814-aae97537ed98 service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-6f37af28-15a6-4916-aad0-bb70d735c935 req-57d333e1-fb60-40c3-8814-aae97537ed98 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] No waiting events found dispatching network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:17 user nova-compute[72818]: WARNING nova.compute.manager [req-6f37af28-15a6-4916-aad0-bb70d735c935 req-57d333e1-fb60-40c3-8814-aae97537ed98 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received unexpected event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 for instance with vm_state active and task_state rescuing.
Aug 17 21:21:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 21:21:19 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307279.4132376, 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:21:19 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] VM Resumed (Lifecycle Event)
Aug 17 21:21:19 user nova-compute[72818]: DEBUG nova.compute.manager [None req-4309dee2-ba8e-4b0f-a3af-0b3da80b1385 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:21:19 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:21:19 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:21:19 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 21:21:19 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307279.419793, 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:21:19 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] VM Started (Lifecycle Event)
Aug 17 21:21:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-11b60d3a-21c8-4256-af2e-d7bf4278aa6f req-aec33241-ddd2-44d2-9b22-7bd0780818f9 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-11b60d3a-21c8-4256-af2e-d7bf4278aa6f req-aec33241-ddd2-44d2-9b22-7bd0780818f9 service nova] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-11b60d3a-21c8-4256-af2e-d7bf4278aa6f req-aec33241-ddd2-44d2-9b22-7bd0780818f9 service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-11b60d3a-21c8-4256-af2e-d7bf4278aa6f req-aec33241-ddd2-44d2-9b22-7bd0780818f9 service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-11b60d3a-21c8-4256-af2e-d7bf4278aa6f req-aec33241-ddd2-44d2-9b22-7bd0780818f9 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] No waiting events found dispatching network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:19 user nova-compute[72818]: WARNING nova.compute.manager [req-11b60d3a-21c8-4256-af2e-d7bf4278aa6f req-aec33241-ddd2-44d2-9b22-7bd0780818f9 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received unexpected event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 for instance with vm_state active and task_state rescuing.
Aug 17 21:21:19 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:21:19 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:21:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:29 user nova-compute[72818]: INFO nova.compute.manager [None req-b02245e0-2c77-4afd-8003-a72ab422fb16 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Unrescuing
Aug 17 21:21:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b02245e0-2c77-4afd-8003-a72ab422fb16 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:21:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b02245e0-2c77-4afd-8003-a72ab422fb16 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquired lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:21:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b02245e0-2c77-4afd-8003-a72ab422fb16 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:21:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b02245e0-2c77-4afd-8003-a72ab422fb16 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Updating instance_info_cache with network_info: [{"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:21:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b02245e0-2c77-4afd-8003-a72ab422fb16 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Releasing lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:21:30 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b02245e0-2c77-4afd-8003-a72ab422fb16 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'flavor' on Instance uuid 827d6c12-deb5-4c05-ad6b-efba319783e9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:21:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-ac637ab8-5e0d-42a6-bc69-e087cde6d276 req-afcc4d88-f47c-4d4a-9d8a-e018d31d3536 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-unplugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ac637ab8-5e0d-42a6-bc69-e087cde6d276 req-afcc4d88-f47c-4d4a-9d8a-e018d31d3536 service nova] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ac637ab8-5e0d-42a6-bc69-e087cde6d276 req-afcc4d88-f47c-4d4a-9d8a-e018d31d3536 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ac637ab8-5e0d-42a6-bc69-e087cde6d276 req-afcc4d88-f47c-4d4a-9d8a-e018d31d3536 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-ac637ab8-5e0d-42a6-bc69-e087cde6d276 req-afcc4d88-f47c-4d4a-9d8a-e018d31d3536 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] No waiting events found dispatching network-vif-unplugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:30 user nova-compute[72818]: WARNING nova.compute.manager [req-ac637ab8-5e0d-42a6-bc69-e087cde6d276 req-afcc4d88-f47c-4d4a-9d8a-e018d31d3536 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received unexpected event network-vif-unplugged-67586c8a-e841-4778-891e-27307f1dbe67 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:21:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:31 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Instance destroyed successfully.
Aug 17 21:21:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-1e176225-8525-4ed6-a7f2-9b12f90c829e req-9639eb36-643c-42de-bda1-a2179d778d81 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1e176225-8525-4ed6-a7f2-9b12f90c829e req-9639eb36-643c-42de-bda1-a2179d778d81 service nova] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1e176225-8525-4ed6-a7f2-9b12f90c829e req-9639eb36-643c-42de-bda1-a2179d778d81 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1e176225-8525-4ed6-a7f2-9b12f90c829e req-9639eb36-643c-42de-bda1-a2179d778d81 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-1e176225-8525-4ed6-a7f2-9b12f90c829e req-9639eb36-643c-42de-bda1-a2179d778d81 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] No waiting events found dispatching network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:32 user nova-compute[72818]: WARNING nova.compute.manager [req-1e176225-8525-4ed6-a7f2-9b12f90c829e req-9639eb36-643c-42de-bda1-a2179d778d81 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received unexpected event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:21:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for 827d6c12-deb5-4c05-ad6b-efba319783e9 due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307294.8661213, 827d6c12-deb5-4c05-ad6b-efba319783e9 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:21:34 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] VM Resumed (Lifecycle Event)
Aug 17 21:21:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b02245e0-2c77-4afd-8003-a72ab422fb16 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-1242d140-6076-436a-9f58-4121058487d2 req-4b85a60a-ba25-4921-9f32-405b0f172719 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1242d140-6076-436a-9f58-4121058487d2 req-4b85a60a-ba25-4921-9f32-405b0f172719 service nova] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1242d140-6076-436a-9f58-4121058487d2 req-4b85a60a-ba25-4921-9f32-405b0f172719 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1242d140-6076-436a-9f58-4121058487d2 req-4b85a60a-ba25-4921-9f32-405b0f172719 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-1242d140-6076-436a-9f58-4121058487d2 req-4b85a60a-ba25-4921-9f32-405b0f172719 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] No waiting events found dispatching network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:34 user nova-compute[72818]: WARNING nova.compute.manager [req-1242d140-6076-436a-9f58-4121058487d2 req-4b85a60a-ba25-4921-9f32-405b0f172719 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received unexpected event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:21:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-1242d140-6076-436a-9f58-4121058487d2 req-4b85a60a-ba25-4921-9f32-405b0f172719 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1242d140-6076-436a-9f58-4121058487d2 req-4b85a60a-ba25-4921-9f32-405b0f172719 service nova] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1242d140-6076-436a-9f58-4121058487d2 req-4b85a60a-ba25-4921-9f32-405b0f172719 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1242d140-6076-436a-9f58-4121058487d2 req-4b85a60a-ba25-4921-9f32-405b0f172719 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-1242d140-6076-436a-9f58-4121058487d2 req-4b85a60a-ba25-4921-9f32-405b0f172719 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] No waiting events found dispatching network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:34 user nova-compute[72818]: WARNING nova.compute.manager [req-1242d140-6076-436a-9f58-4121058487d2 req-4b85a60a-ba25-4921-9f32-405b0f172719 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received unexpected event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:21:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:21:34 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 21:21:34 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307294.8676035, 827d6c12-deb5-4c05-ad6b-efba319783e9 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:21:34 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] VM Started (Lifecycle Event)
Aug 17 21:21:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:21:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:21:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid b9a0da7f-47b4-467f-944d-49adac671a06 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid b93c6b2f-59ee-4e7f-9805-97ef627eccdb {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 01fcc357-dc4c-4215-b3a5-b9cea51ed532 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 48b00603-33ea-4eaa-b445-934ba1ab88f4 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 827d6c12-deb5-4c05-ad6b-efba319783e9 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 4b43de5d-62c1-4368-8a77-59899ae0b16d {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid ac704cc9-16b1-4bf5-830a-f1ca33c97c6a {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid be9e52eb-e0db-4b00-aa69-b8506b2275fe {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 774642dc-1888-4f4e-9485-b6dfe7ad6a7f {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "b9a0da7f-47b4-467f-944d-49adac671a06" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "b9a0da7f-47b4-467f-944d-49adac671a06" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:37 user nova-compute[72818]: WARNING oslo_messaging._drivers.amqpdriver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "b9a0da7f-47b4-467f-944d-49adac671a06" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:43 user nova-compute[72818]: INFO nova.compute.manager [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Terminating instance
Aug 17 21:21:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-208a3630-3636-4206-b14a-1ed7a743ae78 req-ffe90b33-f8c9-4235-a2a6-5cf70b16f5a4 service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Received event network-vif-unplugged-e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-208a3630-3636-4206-b14a-1ed7a743ae78 req-ffe90b33-f8c9-4235-a2a6-5cf70b16f5a4 service nova] Acquiring lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-208a3630-3636-4206-b14a-1ed7a743ae78 req-ffe90b33-f8c9-4235-a2a6-5cf70b16f5a4 service nova] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-208a3630-3636-4206-b14a-1ed7a743ae78 req-ffe90b33-f8c9-4235-a2a6-5cf70b16f5a4 service nova] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-208a3630-3636-4206-b14a-1ed7a743ae78 req-ffe90b33-f8c9-4235-a2a6-5cf70b16f5a4 service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] No waiting events found dispatching network-vif-unplugged-e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-208a3630-3636-4206-b14a-1ed7a743ae78 req-ffe90b33-f8c9-4235-a2a6-5cf70b16f5a4 service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Received event network-vif-unplugged-e94f410f-1593-4c05-ae40-a8c34f12c210 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:21:44 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Instance destroyed successfully.
Aug 17 21:21:44 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lazy-loading 'resources' on Instance uuid b93c6b2f-59ee-4e7f-9805-97ef627eccdb {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:21:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1281543925',display_name='tempest-VolumesAdminNegativeTest-server-1281543925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1281543925',id=3,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtFclPFjSP/42/RDUl6TDrox7+s9GiwKes/5lRbYQGq2xerW1PvPXcvnWfT+eHcrWbRmThiUKcPp+BSugRt8X4G8isgmYwFEKZpmUenXJPnsI1hD9NjvgXCQaM/DKoIQQ==',key_name='tempest-keypair-1123154090',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f25ddb77be74b0184e1685cd0e34122',ramdisk_id='',reservation_id='r-yxru26xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-342058843',owner_user_name='tempest-VolumesAdminNegativeTest-342058843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:15:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a882239cd3054ad3abc93fd0b32a70c7',uuid=b93c6b2f-59ee-4e7f-9805-97ef627eccdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e94f410f-1593-4c05-ae40-a8c34f12c210", "address": "fa:16:3e:69:af:13", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94f410f-15", "ovs_interfaceid": "e94f410f-1593-4c05-ae40-a8c34f12c210", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:21:44 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Converting VIF {"id": "e94f410f-1593-4c05-ae40-a8c34f12c210", "address": "fa:16:3e:69:af:13", "network": {"id": "ded5255b-3676-4fcf-b1d6-ffef332a5371", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2063052162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f25ddb77be74b0184e1685cd0e34122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape94f410f-15", "ovs_interfaceid": "e94f410f-1593-4c05-ae40-a8c34f12c210", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:21:44 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:af:13,bridge_name='br-int',has_traffic_filtering=True,id=e94f410f-1593-4c05-ae40-a8c34f12c210,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94f410f-15') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:21:44 user nova-compute[72818]: DEBUG os_vif [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:af:13,bridge_name='br-int',has_traffic_filtering=True,id=e94f410f-1593-4c05-ae40-a8c34f12c210,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94f410f-15') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:21:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape94f410f-15, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:21:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:21:44 user nova-compute[72818]: INFO os_vif [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:af:13,bridge_name='br-int',has_traffic_filtering=True,id=e94f410f-1593-4c05-ae40-a8c34f12c210,network=Network(ded5255b-3676-4fcf-b1d6-ffef332a5371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape94f410f-15')
Aug 17 21:21:44 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Deleting instance files /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb_del
Aug 17 21:21:44 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Deletion of /opt/stack/data/nova/instances/b93c6b2f-59ee-4e7f-9805-97ef627eccdb_del complete
Aug 17 21:21:44 user nova-compute[72818]: INFO nova.compute.manager [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 21:21:44 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:21:44 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:21:44 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:21:45 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:21:45 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Took 0.83 seconds to deallocate network for instance.
Aug 17 21:21:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-fef606db-a182-4972-95a8-8e30417a928b req-3802a2c8-00ef-4f04-ab8f-21638e5bdecd service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Received event network-vif-deleted-e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:45 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:21:45 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:21:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:45 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Deleted allocations for instance b93c6b2f-59ee-4e7f-9805-97ef627eccdb
Aug 17 21:21:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba640536-8bb5-4435-a82c-0f2176d02a2d tempest-VolumesAdminNegativeTest-342058843 tempest-VolumesAdminNegativeTest-342058843-project-member] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.312s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-44a0f3cb-ed97-4729-be4c-ef6cea860921 req-da5fda4a-aed4-40e7-839f-54d27089b23c service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Received event network-vif-plugged-e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-44a0f3cb-ed97-4729-be4c-ef6cea860921 req-da5fda4a-aed4-40e7-839f-54d27089b23c service nova] Acquiring lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-44a0f3cb-ed97-4729-be4c-ef6cea860921 req-da5fda4a-aed4-40e7-839f-54d27089b23c service nova] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-44a0f3cb-ed97-4729-be4c-ef6cea860921 req-da5fda4a-aed4-40e7-839f-54d27089b23c service nova] Lock "b93c6b2f-59ee-4e7f-9805-97ef627eccdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-44a0f3cb-ed97-4729-be4c-ef6cea860921 req-da5fda4a-aed4-40e7-839f-54d27089b23c service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] No waiting events found dispatching network-vif-plugged-e94f410f-1593-4c05-ae40-a8c34f12c210 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:45 user nova-compute[72818]: WARNING nova.compute.manager [req-44a0f3cb-ed97-4729-be4c-ef6cea860921 req-da5fda4a-aed4-40e7-839f-54d27089b23c service nova] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Received unexpected event network-vif-plugged-e94f410f-1593-4c05-ae40-a8c34f12c210 for instance with vm_state deleted and task_state None.
Aug 17 21:21:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:21:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:21:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:21:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:51 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:21:51 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:21:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:21:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:21:51 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:21:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Updating instance_info_cache with network_info: [{"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:21:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-01fcc357-dc4c-4215-b3a5-b9cea51ed532" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:21:52 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:21:52 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:21:52 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:21:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:55 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:21:55 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:21:55 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:21:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:55 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:21:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:21:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:58 user nova-compute[72818]: INFO nova.compute.manager [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Terminating instance
Aug 17 21:21:58 user nova-compute[72818]: DEBUG nova.compute.manager [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-5fbe67cc-bbd6-4f63-a7c0-d6612b34373f req-f0c6671c-ccca-4d8e-b899-8349cdf21ac9 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Received event network-vif-unplugged-f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5fbe67cc-bbd6-4f63-a7c0-d6612b34373f req-f0c6671c-ccca-4d8e-b899-8349cdf21ac9 service nova] Acquiring lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5fbe67cc-bbd6-4f63-a7c0-d6612b34373f req-f0c6671c-ccca-4d8e-b899-8349cdf21ac9 service nova] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5fbe67cc-bbd6-4f63-a7c0-d6612b34373f req-f0c6671c-ccca-4d8e-b899-8349cdf21ac9 service nova] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-5fbe67cc-bbd6-4f63-a7c0-d6612b34373f req-f0c6671c-ccca-4d8e-b899-8349cdf21ac9 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] No waiting events found dispatching network-vif-unplugged-f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-5fbe67cc-bbd6-4f63-a7c0-d6612b34373f req-f0c6671c-ccca-4d8e-b899-8349cdf21ac9 service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Received event network-vif-unplugged-f445d362-0f87-4071-82f6-8ea4c42fbb4f for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:59 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Instance destroyed successfully.
Aug 17 21:21:59 user nova-compute[72818]: DEBUG nova.objects.instance [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lazy-loading 'resources' on Instance uuid 01fcc357-dc4c-4215-b3a5-b9cea51ed532 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:15:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1606846035',display_name='tempest-TestVolumeSwap-server-1606846035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1606846035',id=7,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBtOm9NxkO+LlLIZ1zt2HQ05QAzx0rq5/NEq21BT09bJjoa4VLqZPCG7pn1i4JRSovoX2GrqQJplj7foifbKkPiO9FJJGzOgJAqzR/+/0pAIZeww7rZhf75CtTgEKm/WQ==',key_name='tempest-keypair-1231593536',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61674e45592b48cea88c97dd0366c9e0',ramdisk_id='',reservation_id='r-z5ri58gh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2120630356',owner_user_name='tempest-TestVolumeSwap-2120630356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ea750eeca8943b49271dc8ac038a17f',uuid=01fcc357-dc4c-4215-b3a5-b9cea51ed532,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Converting VIF {"id": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "address": "fa:16:3e:46:ab:48", "network": {"id": "ecab8083-74b1-4520-b228-7bf3dbcce2c4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-882353250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61674e45592b48cea88c97dd0366c9e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf445d362-0f", "ovs_interfaceid": "f445d362-0f87-4071-82f6-8ea4c42fbb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:ab:48,bridge_name='br-int',has_traffic_filtering=True,id=f445d362-0f87-4071-82f6-8ea4c42fbb4f,network=Network(ecab8083-74b1-4520-b228-7bf3dbcce2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf445d362-0f') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG os_vif [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ab:48,bridge_name='br-int',has_traffic_filtering=True,id=f445d362-0f87-4071-82f6-8ea4c42fbb4f,network=Network(ecab8083-74b1-4520-b228-7bf3dbcce2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf445d362-0f') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf445d362-0f, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:21:59 user nova-compute[72818]: INFO os_vif [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ab:48,bridge_name='br-int',has_traffic_filtering=True,id=f445d362-0f87-4071-82f6-8ea4c42fbb4f,network=Network(ecab8083-74b1-4520-b228-7bf3dbcce2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf445d362-0f')
Aug 17 21:21:59 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Deleting instance files /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532_del
Aug 17 21:21:59 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Deletion of /opt/stack/data/nova/instances/01fcc357-dc4c-4215-b3a5-b9cea51ed532_del complete
Aug 17 21:21:59 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307304.1391034, b93c6b2f-59ee-4e7f-9805-97ef627eccdb => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:21:59 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] VM Stopped (Lifecycle Event)
Aug 17 21:21:59 user nova-compute[72818]: INFO nova.compute.manager [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 21:21:59 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0ab52c2d-2064-4f78-bfe0-92ba56034a72 None None] [instance: b93c6b2f-59ee-4e7f-9805-97ef627eccdb] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:21:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:00 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:22:00 user nova-compute[72818]: DEBUG nova.compute.manager [req-034c02b8-0b1e-4860-9a4f-8fb7841d8e1d req-45965ea8-aae5-4dec-ab63-14db0cd2ba7c service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Received event network-vif-deleted-f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:00 user nova-compute[72818]: INFO nova.compute.manager [req-034c02b8-0b1e-4860-9a4f-8fb7841d8e1d req-45965ea8-aae5-4dec-ab63-14db0cd2ba7c service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Neutron deleted interface f445d362-0f87-4071-82f6-8ea4c42fbb4f; detaching it from the instance and deleting it from the info cache
Aug 17 21:22:00 user nova-compute[72818]: DEBUG nova.network.neutron [req-034c02b8-0b1e-4860-9a4f-8fb7841d8e1d req-45965ea8-aae5-4dec-ab63-14db0cd2ba7c service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:22:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:00 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Took 0.91 seconds to deallocate network for instance.
Aug 17 21:22:00 user nova-compute[72818]: DEBUG nova.compute.manager [req-034c02b8-0b1e-4860-9a4f-8fb7841d8e1d req-45965ea8-aae5-4dec-ab63-14db0cd2ba7c service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Detach interface failed, port_id=f445d362-0f87-4071-82f6-8ea4c42fbb4f, reason: Instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532 could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:22:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:00 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:22:00 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:22:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7247MB free_disk=25.34958267211914GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:22:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:00 user nova-compute[72818]: DEBUG nova.compute.manager [req-9ecde68d-6458-4729-b98a-5fb2bd70b558 req-6c311ea8-a32f-4a04-8e2b-2ffe3abbe45c service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Received event network-vif-plugged-f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9ecde68d-6458-4729-b98a-5fb2bd70b558 req-6c311ea8-a32f-4a04-8e2b-2ffe3abbe45c service nova] Acquiring lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9ecde68d-6458-4729-b98a-5fb2bd70b558 req-6c311ea8-a32f-4a04-8e2b-2ffe3abbe45c service nova] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9ecde68d-6458-4729-b98a-5fb2bd70b558 req-6c311ea8-a32f-4a04-8e2b-2ffe3abbe45c service nova] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:00 user nova-compute[72818]: DEBUG nova.compute.manager [req-9ecde68d-6458-4729-b98a-5fb2bd70b558 req-6c311ea8-a32f-4a04-8e2b-2ffe3abbe45c service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] No waiting events found dispatching network-vif-plugged-f445d362-0f87-4071-82f6-8ea4c42fbb4f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:22:00 user nova-compute[72818]: WARNING nova.compute.manager [req-9ecde68d-6458-4729-b98a-5fb2bd70b558 req-6c311ea8-a32f-4a04-8e2b-2ffe3abbe45c service nova] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Received unexpected event network-vif-plugged-f445d362-0f87-4071-82f6-8ea4c42fbb4f for instance with vm_state deleted and task_state None.
Aug 17 21:22:00 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:22:00 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.373s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:01 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Deleted allocations for instance 01fcc357-dc4c-4215-b3a5-b9cea51ed532
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e8b5ccab-5dff-4458-a799-8c8528a032b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance be9e52eb-e0db-4b00-aa69-b8506b2275fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 774642dc-1888-4f4e-9485-b6dfe7ad6a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-87f660dd-57f0-451d-b20b-c953e730770c tempest-TestVolumeSwap-2120630356 tempest-TestVolumeSwap-2120630356-project-member] Lock "01fcc357-dc4c-4215-b3a5-b9cea51ed532" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.930s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:22:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:02 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:22:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-3839d8cc-df7d-4f33-8c83-127f6aa57a3b req-a374fd2e-479d-41e3-a61c-0115aeddcf96 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Received event network-changed-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-3839d8cc-df7d-4f33-8c83-127f6aa57a3b req-a374fd2e-479d-41e3-a61c-0115aeddcf96 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Refreshing instance network info cache due to event network-changed-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3839d8cc-df7d-4f33-8c83-127f6aa57a3b req-a374fd2e-479d-41e3-a61c-0115aeddcf96 service nova] Acquiring lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3839d8cc-df7d-4f33-8c83-127f6aa57a3b req-a374fd2e-479d-41e3-a61c-0115aeddcf96 service nova] Acquired lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG nova.network.neutron [req-3839d8cc-df7d-4f33-8c83-127f6aa57a3b req-a374fd2e-479d-41e3-a61c-0115aeddcf96 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Refreshing network info cache for port c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG nova.network.neutron [req-3839d8cc-df7d-4f33-8c83-127f6aa57a3b req-a374fd2e-479d-41e3-a61c-0115aeddcf96 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updated VIF entry in instance network info cache for port c48bf93f-2922-454f-a8ac-f8a92d7b0b6a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG nova.network.neutron [req-3839d8cc-df7d-4f33-8c83-127f6aa57a3b req-a374fd2e-479d-41e3-a61c-0115aeddcf96 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updating instance_info_cache with network_info: [{"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG nova.objects.instance [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'flavor' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3839d8cc-df7d-4f33-8c83-127f6aa57a3b req-a374fd2e-479d-41e3-a61c-0115aeddcf96 service nova] Releasing lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:22:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:07 user nova-compute[72818]: INFO nova.compute.manager [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Attaching volume 943bedfa-18f9-40fc-a827-0e911837568b to /dev/vdb
Aug 17 21:22:07 user nova-compute[72818]: DEBUG os_brick.utils [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cbe062-900d-43e7-95fe-0ad04fb693ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd88a56-fea8-466f-bd35-605f5dcf66f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e527a8-23e3-4c27-abb1-04e6e1660378]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d8063f-355e-4611-9867-c5dae8701f29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:22:07 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:22:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f255f6b-acf5-4c25-b4ab-74e9fa12b27c]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG os_brick.utils [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:22:07 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating existing volume attachment record: 859d52bf-dabe-486b-9661-824a80e3d69c {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:22:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:14 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307319.035395, 01fcc357-dc4c-4215-b3a5-b9cea51ed532 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:22:14 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] VM Stopped (Lifecycle Event)
Aug 17 21:22:14 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8b8963d2-82e2-40a9-90ed-092a9cb63d6a None None] [instance: 01fcc357-dc4c-4215-b3a5-b9cea51ed532] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:22:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTbWkAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:22:18 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:22:18 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:22:18 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa0ed7b-1f66-44df-ae90-2ebba385c101]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:22:18 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4078c0-8260-44ff-a408-374f3dc3e848]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b] added
Aug 17 21:22:18 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d282a9-91ce-4da8-b8db-e25fc63e310e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b253a99-60cd-469e-9521-a10d3ed3a0c8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gfTbWkAM {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gfTbWkAM" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d7e415-de24-41ae-80a3-97145eb322cd]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gfTbWkAM'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c2be91-92b3-47aa-ab57-cd8406edb25c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[257962d9-f447-4e05-aa5c-076f267ab60c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:18 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:18 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b7fa45-0357-4aaa-be44-a7ce904d1517]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260]
Aug 17 21:22:18 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260] successful.
Aug 17 21:22:18 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[988189e7-847b-4167-9726-be266e77e593]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6066c083-1187-4608-9491-05ca4930d98b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:18 user nova-compute[72818]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:22:18 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:18 user nova-compute[72818]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:22:18 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3f1f57-7a24-4329-b0a2-edde3acf0d79]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:18 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:22:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:19 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:22:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTbWkAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:22:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:22:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23063336463326336', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:22:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063336463326336', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:22:19 user nova-compute[72818]: DEBUG nova.objects.instance [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'flavor' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:22:19 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:22:19 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:22:19 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:22:19 user nova-compute[72818]:   <serial>943bedfa-18f9-40fc-a827-0e911837568b</serial>
Aug 17 21:22:19 user nova-compute[72818]: </disk>
Aug 17 21:22:19 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:22:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:22:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:22:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] No VIF found with MAC fa:16:3e:ba:1c:1e, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:22:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1970468b-cb7b-4be7-bc08-781ae60849c6 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.394s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Stashing vm_state: active {{(pid=72818) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 21:22:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:23 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'pci_requests' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:23 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:22:23 user nova-compute[72818]: INFO nova.compute.claims [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Claim successful on node user
Aug 17 21:22:23 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'resources' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:23 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'pci_devices' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:23 user nova-compute[72818]: INFO nova.compute.resource_tracker [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating resource usage from migration 7b55f893-ec80-4bfa-beeb-8857fda52608
Aug 17 21:22:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:24 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:22:24 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:22:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.478s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:24 user nova-compute[72818]: INFO nova.compute.manager [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Migrating
Aug 17 21:22:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:22:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:22:24 user nova-compute[72818]: INFO nova.compute.rpcapi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 17 21:22:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:22:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-20063176-a198-468c-91a9-6c4f9bf9db7c req-a2afaf28-411c-43ba-8f0e-0dcfab0495f5 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Received event network-changed-35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-20063176-a198-468c-91a9-6c4f9bf9db7c req-a2afaf28-411c-43ba-8f0e-0dcfab0495f5 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Refreshing instance network info cache due to event network-changed-35432717-090b-446d-b18d-10fd618b2cf9. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:22:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-20063176-a198-468c-91a9-6c4f9bf9db7c req-a2afaf28-411c-43ba-8f0e-0dcfab0495f5 service nova] Acquiring lock "refresh_cache-be9e52eb-e0db-4b00-aa69-b8506b2275fe" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:22:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-20063176-a198-468c-91a9-6c4f9bf9db7c req-a2afaf28-411c-43ba-8f0e-0dcfab0495f5 service nova] Acquired lock "refresh_cache-be9e52eb-e0db-4b00-aa69-b8506b2275fe" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:22:24 user nova-compute[72818]: DEBUG nova.network.neutron [req-20063176-a198-468c-91a9-6c4f9bf9db7c req-a2afaf28-411c-43ba-8f0e-0dcfab0495f5 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Refreshing network info cache for port 35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:22:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:22:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquired lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:22:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:22:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-20063176-a198-468c-91a9-6c4f9bf9db7c req-a2afaf28-411c-43ba-8f0e-0dcfab0495f5 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Updated VIF entry in instance network info cache for port 35432717-090b-446d-b18d-10fd618b2cf9. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:22:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-20063176-a198-468c-91a9-6c4f9bf9db7c req-a2afaf28-411c-43ba-8f0e-0dcfab0495f5 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Updating instance_info_cache with network_info: [{"id": "35432717-090b-446d-b18d-10fd618b2cf9", "address": "fa:16:3e:82:95:1b", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35432717-09", "ovs_interfaceid": "35432717-090b-446d-b18d-10fd618b2cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:22:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-20063176-a198-468c-91a9-6c4f9bf9db7c req-a2afaf28-411c-43ba-8f0e-0dcfab0495f5 service nova] Releasing lock "refresh_cache-be9e52eb-e0db-4b00-aa69-b8506b2275fe" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:22:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating instance_info_cache with network_info: [{"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:22:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Releasing lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:22:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Starting migrate_disk_and_power_off {{(pid=72818) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 21:22:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG nova.objects.instance [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lazy-loading 'flavor' on Instance uuid be9e52eb-e0db-4b00-aa69-b8506b2275fe {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-3b209470-a32b-4ad5-9f20-fb1c54f9a93f req-c01f24f8-f271-48bc-8330-69c70c2b3e65 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-unplugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3b209470-a32b-4ad5-9f20-fb1c54f9a93f req-c01f24f8-f271-48bc-8330-69c70c2b3e65 service nova] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3b209470-a32b-4ad5-9f20-fb1c54f9a93f req-c01f24f8-f271-48bc-8330-69c70c2b3e65 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3b209470-a32b-4ad5-9f20-fb1c54f9a93f req-c01f24f8-f271-48bc-8330-69c70c2b3e65 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-3b209470-a32b-4ad5-9f20-fb1c54f9a93f req-c01f24f8-f271-48bc-8330-69c70c2b3e65 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] No waiting events found dispatching network-vif-unplugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:22:26 user nova-compute[72818]: WARNING nova.compute.manager [req-3b209470-a32b-4ad5-9f20-fb1c54f9a93f req-c01f24f8-f271-48bc-8330-69c70c2b3e65 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received unexpected event network-vif-unplugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 for instance with vm_state active and task_state resize_migrating.
Aug 17 21:22:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:26 user nova-compute[72818]: INFO nova.compute.manager [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Attaching volume 4fd6e689-388a-4dc1-bc05-d08309530a7c to /dev/vdb
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.utils [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ce3c53-e548-4cb6-ada5-ea43505dc60f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d1b991-63f6-4f9f-88d5-3f822a71b3ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9a2348-d1fd-425f-b30f-cea2e6920583]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8b501b-51ac-44e0-8e84-2f2c2d873c74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance destroyed successfully.
Aug 17 21:22:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949986485',display_name='tempest-ServerActionsTestOtherB-server-949986485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949986485',id=13,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRc64wH9u6dm3xi4kk/wBQ/vGvOzR5k+mWwsr3HttVU/OU3wMLvrRNNKLA460//NVqERVsDyz6LYVlThM/1o9Ih8+/vljt/Rg70GDESbu8oCMaWXuSfr3pfnG0YVMizwg==',key_name='tempest-keypair-722674119',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:18:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a18e542cdfb74711b0decf0c1f008e0b',ramdisk_id='',reservation_id='r-jwckp96f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1842371167',owner_user_name='tempest-ServerActionsTestOtherB-1842371167-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e0d4b90694b09a71fc7790bb532df',uuid=e8b5ccab-5dff-4458-a799-8c8528a032b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-558718957-network", "vif_mac": "fa:16:3e:ba:1c:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converting VIF {"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-558718957-network", "vif_mac": "fa:16:3e:ba:1c:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_vif [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25efe920-cf, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:22:26 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c820fa-d473-45fd-8f11-23d3ee00b996]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.utils [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Updating existing volume attachment record: b451738a-bbeb-43c6-a6f3-114b2d5c5e49 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:22:26 user nova-compute[72818]: INFO os_vif [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf')
Aug 17 21:22:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTbWkAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:22:26 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5796f345-3b98-4bb2-87f0-1e030006b79c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc00199-9b17-4938-8f12-95522412a8e9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:26 user nova-compute[72818]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:22:26 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:26 user nova-compute[72818]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:22:26 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04dffac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ebd7a4-422b-464b-90b9-0a606c7d37de]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9289b59c-faa5-415c-a028-81f0633a8c5f]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[089d71a1-6f33-4f39-aefa-34bc866ebb01]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3dfa87-6c1a-46f1-a24f-6b93db5aeb21]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d6a088-7303-4f29-b348-1f59e4965c6b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ed78b8-d862-4012-b140-2151cb8a9bdf]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260]
Aug 17 21:22:26 user nova-compute[72818]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260] successful.
Aug 17 21:22:26 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d70dff6-012f-4983-882e-7d32a40eb0b7]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] <== disconnect_volume: return (308ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:22:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:22:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1_resize/disk /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CMD "cp -r /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1_resize/disk /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk" returned: 0 in 0.339s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1_resize/disk.info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk.info {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CMD "cp -r /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1_resize/disk.info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk.info" returned: 0 in 0.036s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-79d092d1-2e15-4578-838e-d06c5f2f50dd req-d8cffa90-efd8-441a-b3aa-b8b67672e882 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-79d092d1-2e15-4578-838e-d06c5f2f50dd req-d8cffa90-efd8-441a-b3aa-b8b67672e882 service nova] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-79d092d1-2e15-4578-838e-d06c5f2f50dd req-d8cffa90-efd8-441a-b3aa-b8b67672e882 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-79d092d1-2e15-4578-838e-d06c5f2f50dd req-d8cffa90-efd8-441a-b3aa-b8b67672e882 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-79d092d1-2e15-4578-838e-d06c5f2f50dd req-d8cffa90-efd8-441a-b3aa-b8b67672e882 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] No waiting events found dispatching network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:22:28 user nova-compute[72818]: WARNING nova.compute.manager [req-79d092d1-2e15-4578-838e-d06c5f2f50dd req-d8cffa90-efd8-441a-b3aa-b8b67672e882 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received unexpected event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 for instance with vm_state active and task_state resize_migrating.
Aug 17 21:22:28 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Port 25efe920-cfdf-428d-86ee-0f9b8f301e11 binding to destination host user is already ACTIVE {{(pid=72818) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquired lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "587af1f4-36d1-4bbd-a091-b42857ee8637" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:22:29 user nova-compute[72818]: INFO nova.compute.claims [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Claim successful on node user
Aug 17 21:22:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating instance_info_cache with network_info: [{"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Releasing lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG os_brick.utils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e54d55-1fa0-414b-869e-4cfc452278a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e915c-f333-48d3-b96e-be7e030649e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a0e803-1c86-42eb-bf03-1ab5e7d71106]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[48901f9f-5afc-4a15-ab8b-60378dbf4256]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:22:29 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:22:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1617d7b1-de17-40a6-b30a-54feca2d5cdc]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:22:29 user nova-compute[72818]: DEBUG os_brick.utils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:22:30 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:22:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG nova.policy [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44662762d7924c16aaa0dfa5c38e5983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3427d284fd1446f8b7144adeef980549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:22:30 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Creating image(s)
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "/opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "/opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "/opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.198s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk 1073741824" returned: 0 in 0.062s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.218s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Cannot resize image /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG nova.objects.instance [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lazy-loading 'migration_context' on Instance uuid 587af1f4-36d1-4bbd-a091-b42857ee8637 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Ensure instance console log exists: /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Successfully created port: b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Successfully updated port: b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "refresh_cache-587af1f4-36d1-4bbd-a091-b42857ee8637" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquired lock "refresh_cache-587af1f4-36d1-4bbd-a091-b42857ee8637" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-92bd7b68-16c8-492a-a645-27d29e10887a req-382b246c-45c5-4736-b4e5-be97749ebd7c service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Received event network-changed-b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-92bd7b68-16c8-492a-a645-27d29e10887a req-382b246c-45c5-4736-b4e5-be97749ebd7c service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Refreshing instance network info cache due to event network-changed-b1c58ade-9008-4db9-9c4f-29a6b2765a1a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-92bd7b68-16c8-492a-a645-27d29e10887a req-382b246c-45c5-4736-b4e5-be97749ebd7c service nova] Acquiring lock "refresh_cache-587af1f4-36d1-4bbd-a091-b42857ee8637" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Updating instance_info_cache with network_info: [{"id": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "address": "fa:16:3e:b1:57:ff", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c58ade-90", "ovs_interfaceid": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Releasing lock "refresh_cache-587af1f4-36d1-4bbd-a091-b42857ee8637" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Instance network_info: |[{"id": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "address": "fa:16:3e:b1:57:ff", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c58ade-90", "ovs_interfaceid": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-92bd7b68-16c8-492a-a645-27d29e10887a req-382b246c-45c5-4736-b4e5-be97749ebd7c service nova] Acquired lock "refresh_cache-587af1f4-36d1-4bbd-a091-b42857ee8637" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.network.neutron [req-92bd7b68-16c8-492a-a645-27d29e10887a req-382b246c-45c5-4736-b4e5-be97749ebd7c service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Refreshing network info cache for port b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Start _get_guest_xml network_info=[{"id": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "address": "fa:16:3e:b1:57:ff", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c58ade-90", "ovs_interfaceid": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:22:32 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:22:32 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:22:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-529779464',display_name='tempest-VolumesSnapshotTestJSON-instance-529779464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-529779464',id=20,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcU4dgY9MLSuSN395Bm+eAlXk6tS6t6Iql6pHs0t2AnsYPkwCiX8ykW4AI3UxLHTbMyC9WKyyl9BjXjkOHN1nBcmTVYYDtq9dNFn5wRU9nCfpXxhj+1wnLq1KQsfFXwDg==',key_name='tempest-keypair-2031883052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3427d284fd1446f8b7144adeef980549',ramdisk_id='',reservation_id='r-0n7g7c10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-473153764',owner_user_name='tempest-VolumesSnapshotTestJSON-473153764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44662762d7924c16aaa0dfa5c38e5983',uuid=587af1f4-36d1-4bbd-a091-b42857ee8637,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "address": "fa:16:3e:b1:57:ff", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c58ade-90", "ovs_interfaceid": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Converting VIF {"id": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "address": "fa:16:3e:b1:57:ff", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c58ade-90", "ovs_interfaceid": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=b1c58ade-9008-4db9-9c4f-29a6b2765a1a,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c58ade-90') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.objects.instance [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lazy-loading 'pci_devices' on Instance uuid 587af1f4-36d1-4bbd-a091-b42857ee8637 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:22:32 user nova-compute[72818]:   <uuid>587af1f4-36d1-4bbd-a091-b42857ee8637</uuid>
Aug 17 21:22:32 user nova-compute[72818]:   <name>instance-00000014</name>
Aug 17 21:22:32 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:22:32 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:22:32 user nova-compute[72818]:   <metadata>
Aug 17 21:22:32 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:22:32 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:22:32 user nova-compute[72818]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-529779464</nova:name>
Aug 17 21:22:32 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:22:32</nova:creationTime>
Aug 17 21:22:32 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:22:32 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:22:32 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:22:32 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:22:32 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:22:32 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:22:32 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:22:32 user nova-compute[72818]:       <nova:owner>
Aug 17 21:22:32 user nova-compute[72818]:         <nova:user uuid="44662762d7924c16aaa0dfa5c38e5983">tempest-VolumesSnapshotTestJSON-473153764-project-member</nova:user>
Aug 17 21:22:32 user nova-compute[72818]:         <nova:project uuid="3427d284fd1446f8b7144adeef980549">tempest-VolumesSnapshotTestJSON-473153764</nova:project>
Aug 17 21:22:32 user nova-compute[72818]:       </nova:owner>
Aug 17 21:22:32 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:22:32 user nova-compute[72818]:       <nova:ports>
Aug 17 21:22:32 user nova-compute[72818]:         <nova:port uuid="b1c58ade-9008-4db9-9c4f-29a6b2765a1a">
Aug 17 21:22:32 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 21:22:32 user nova-compute[72818]:         </nova:port>
Aug 17 21:22:32 user nova-compute[72818]:       </nova:ports>
Aug 17 21:22:32 user nova-compute[72818]:     </nova:instance>
Aug 17 21:22:32 user nova-compute[72818]:   </metadata>
Aug 17 21:22:32 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:22:32 user nova-compute[72818]:     <system>
Aug 17 21:22:32 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:22:32 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:22:32 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:22:32 user nova-compute[72818]:       <entry name="serial">587af1f4-36d1-4bbd-a091-b42857ee8637</entry>
Aug 17 21:22:32 user nova-compute[72818]:       <entry name="uuid">587af1f4-36d1-4bbd-a091-b42857ee8637</entry>
Aug 17 21:22:32 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:22:32 user nova-compute[72818]:     </system>
Aug 17 21:22:32 user nova-compute[72818]:   </sysinfo>
Aug 17 21:22:32 user nova-compute[72818]:   <os>
Aug 17 21:22:32 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:22:32 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:22:32 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:22:32 user nova-compute[72818]:   </os>
Aug 17 21:22:32 user nova-compute[72818]:   <features>
Aug 17 21:22:32 user nova-compute[72818]:     <acpi/>
Aug 17 21:22:32 user nova-compute[72818]:     <apic/>
Aug 17 21:22:32 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:22:32 user nova-compute[72818]:   </features>
Aug 17 21:22:32 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:22:32 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:22:32 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:22:32 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:22:32 user nova-compute[72818]:   </clock>
Aug 17 21:22:32 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:22:32 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:22:32 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:22:32 user nova-compute[72818]:   </cpu>
Aug 17 21:22:32 user nova-compute[72818]:   <devices>
Aug 17 21:22:32 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:22:32 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:22:32 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk"/>
Aug 17 21:22:32 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:22:32 user nova-compute[72818]:     </disk>
Aug 17 21:22:32 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:22:32 user nova-compute[72818]:       <mac address="fa:16:3e:b1:57:ff"/>
Aug 17 21:22:32 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:22:32 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:22:32 user nova-compute[72818]:       <target dev="tapb1c58ade-90"/>
Aug 17 21:22:32 user nova-compute[72818]:     </interface>
Aug 17 21:22:32 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:22:32 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/console.log" append="off"/>
Aug 17 21:22:32 user nova-compute[72818]:     </serial>
Aug 17 21:22:32 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:22:32 user nova-compute[72818]:     <video>
Aug 17 21:22:32 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:22:32 user nova-compute[72818]:     </video>
Aug 17 21:22:32 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:22:32 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:22:32 user nova-compute[72818]:     </rng>
Aug 17 21:22:32 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:22:32 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:22:32 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:22:32 user nova-compute[72818]:     </memballoon>
Aug 17 21:22:32 user nova-compute[72818]:   </devices>
Aug 17 21:22:32 user nova-compute[72818]: </domain>
Aug 17 21:22:32 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:22:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-529779464',display_name='tempest-VolumesSnapshotTestJSON-instance-529779464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-529779464',id=20,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcU4dgY9MLSuSN395Bm+eAlXk6tS6t6Iql6pHs0t2AnsYPkwCiX8ykW4AI3UxLHTbMyC9WKyyl9BjXjkOHN1nBcmTVYYDtq9dNFn5wRU9nCfpXxhj+1wnLq1KQsfFXwDg==',key_name='tempest-keypair-2031883052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3427d284fd1446f8b7144adeef980549',ramdisk_id='',reservation_id='r-0n7g7c10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-473153764',owner_user_name='tempest-VolumesSnapshotTestJSON-473153764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44662762d7924c16aaa0dfa5c38e5983',uuid=587af1f4-36d1-4bbd-a091-b42857ee8637,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "address": "fa:16:3e:b1:57:ff", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c58ade-90", "ovs_interfaceid": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Converting VIF {"id": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "address": "fa:16:3e:b1:57:ff", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c58ade-90", "ovs_interfaceid": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=b1c58ade-9008-4db9-9c4f-29a6b2765a1a,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c58ade-90') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG os_vif [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=b1c58ade-9008-4db9-9c4f-29a6b2765a1a,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c58ade-90') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1c58ade-90, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1c58ade-90, col_values=(('external_ids', {'iface-id': 'b1c58ade-9008-4db9-9c4f-29a6b2765a1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:57:ff', 'vm-uuid': '587af1f4-36d1-4bbd-a091-b42857ee8637'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:22:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:32 user nova-compute[72818]: INFO os_vif [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=b1c58ade-9008-4db9-9c4f-29a6b2765a1a,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c58ade-90')
Aug 17 21:22:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:22:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] No VIF found with MAC fa:16:3e:b1:57:ff, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:22:33 user nova-compute[72818]: DEBUG nova.network.neutron [req-92bd7b68-16c8-492a-a645-27d29e10887a req-382b246c-45c5-4736-b4e5-be97749ebd7c service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Updated VIF entry in instance network info cache for port b1c58ade-9008-4db9-9c4f-29a6b2765a1a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:22:33 user nova-compute[72818]: DEBUG nova.network.neutron [req-92bd7b68-16c8-492a-a645-27d29e10887a req-382b246c-45c5-4736-b4e5-be97749ebd7c service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Updating instance_info_cache with network_info: [{"id": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "address": "fa:16:3e:b1:57:ff", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c58ade-90", "ovs_interfaceid": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:22:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-92bd7b68-16c8-492a-a645-27d29e10887a req-382b246c-45c5-4736-b4e5-be97749ebd7c service nova] Releasing lock "refresh_cache-587af1f4-36d1-4bbd-a091-b42857ee8637" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:22:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-4932dd55-2fc2-403e-b638-5258d6dcb12d req-7d7d9687-751c-46be-a80c-6aa1d00fce59 service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Received event network-vif-plugged-b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4932dd55-2fc2-403e-b638-5258d6dcb12d req-7d7d9687-751c-46be-a80c-6aa1d00fce59 service nova] Acquiring lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4932dd55-2fc2-403e-b638-5258d6dcb12d req-7d7d9687-751c-46be-a80c-6aa1d00fce59 service nova] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4932dd55-2fc2-403e-b638-5258d6dcb12d req-7d7d9687-751c-46be-a80c-6aa1d00fce59 service nova] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-4932dd55-2fc2-403e-b638-5258d6dcb12d req-7d7d9687-751c-46be-a80c-6aa1d00fce59 service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] No waiting events found dispatching network-vif-plugged-b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:22:34 user nova-compute[72818]: WARNING nova.compute.manager [req-4932dd55-2fc2-403e-b638-5258d6dcb12d req-7d7d9687-751c-46be-a80c-6aa1d00fce59 service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Received unexpected event network-vif-plugged-b1c58ade-9008-4db9-9c4f-29a6b2765a1a for instance with vm_state building and task_state spawning.
Aug 17 21:22:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-a85426e9-6476-461a-85cb-de9006de63f7 req-443d8dfd-ba03-473b-802e-a53064cff83e service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Received event network-vif-plugged-b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a85426e9-6476-461a-85cb-de9006de63f7 req-443d8dfd-ba03-473b-802e-a53064cff83e service nova] Acquiring lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a85426e9-6476-461a-85cb-de9006de63f7 req-443d8dfd-ba03-473b-802e-a53064cff83e service nova] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a85426e9-6476-461a-85cb-de9006de63f7 req-443d8dfd-ba03-473b-802e-a53064cff83e service nova] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-a85426e9-6476-461a-85cb-de9006de63f7 req-443d8dfd-ba03-473b-802e-a53064cff83e service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] No waiting events found dispatching network-vif-plugged-b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:22:36 user nova-compute[72818]: WARNING nova.compute.manager [req-a85426e9-6476-461a-85cb-de9006de63f7 req-443d8dfd-ba03-473b-802e-a53064cff83e service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Received unexpected event network-vif-plugged-b1c58ade-9008-4db9-9c4f-29a6b2765a1a for instance with vm_state building and task_state spawning.
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307356.672547, 587af1f4-36d1-4bbd-a091-b42857ee8637 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:22:36 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] VM Resumed (Lifecycle Event)
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:22:36 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Instance spawned successfully.
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:22:36 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307356.6738038, 587af1f4-36d1-4bbd-a091-b42857ee8637 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:22:36 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] VM Started (Lifecycle Event)
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:22:36 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:22:36 user nova-compute[72818]: INFO nova.compute.manager [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Took 6.50 seconds to spawn the instance on the hypervisor.
Aug 17 21:22:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:22:36 user nova-compute[72818]: INFO nova.compute.manager [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Took 7.39 seconds to build instance.
Aug 17 21:22:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3cc5f1ae-3bd0-415f-8684-18e7cc091df6 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.496s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Starting finish_migration {{(pid=72818) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance directory exists: not creating {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 21:22:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Creating image(s)
Aug 17 21:22:41 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'trusted_certs' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307346.5904994, e8b5ccab-5dff-4458-a799-8c8528a032b1 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:22:41 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] VM Stopped (Lifecycle Event)
Aug 17 21:22:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-42e7a03b-c4c7-462f-b421-3d6862d80bd4 None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-42e7a03b-c4c7-462f-b421-3d6862d80bd4 None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:22:41 user nova-compute[72818]: INFO nova.compute.manager [None req-42e7a03b-c4c7-462f-b421-3d6862d80bd4 None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 21:22:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk. size=21474836480 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk 21474836480 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk 21474836480" returned: 0 in 0.050s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Ensure instance console log exists: /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Start _get_guest_xml network_info=[{"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-558718957-network", "vif_mac": "fa:16:3e:ba:1c:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '9ca6fdfd-a303-44e0-9938-5d3424f94d2c', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTbWkAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e8b5ccab-5dff-4458-a799-8c8528a032b1', 'attached_at': '2023-08-17T21:22:41.000000', 'detached_at': '', 'volume_id': '943bedfa-18f9-40fc-a827-0e911837568b', 'serial': '943bedfa-18f9-40fc-a827-0e911837568b'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:22:42 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:22:42 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:11:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'vcpu_model' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTbWkAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:22:42 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:22:42 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:22:42 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5b40ea-063e-491b-82ca-7e1befeca9e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:22:42 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[221dd2c2-a66b-4f9a-ac59-5fed227d9a84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b] added
Aug 17 21:22:42 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[545e7b28-45ac-476c-b308-3486252880cb]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d124ff-f0ca-409f-a778-48b5d594fc39]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gfTbWkAM {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gfTbWkAM" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade134e7-8a85-409d-8ca8-9023453097a8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gfTbWkAM'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e6c411-ecd8-4776-bd27-efab17af5452]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f48db8a-22d4-418d-b302-95845c05ac8a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:42 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:42 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[61424001-1115-48dc-834e-7223fb5c838c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260]
Aug 17 21:22:42 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260] successful.
Aug 17 21:22:42 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec072cf-2c7c-426a-82cc-753e6061b280]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4da1d42-9808-464c-9a62-54207a443167]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:42 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:22:42 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:42 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:22:42 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1856438d-7b20-4279-b64f-ad0c50ba377d]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTbWkAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:22:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23063336463326336', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063336463326336', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949986485',display_name='tempest-ServerActionsTestOtherB-server-949986485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949986485',id=13,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRc64wH9u6dm3xi4kk/wBQ/vGvOzR5k+mWwsr3HttVU/OU3wMLvrRNNKLA460//NVqERVsDyz6LYVlThM/1o9Ih8+/vljt/Rg70GDESbu8oCMaWXuSfr3pfnG0YVMizwg==',key_name='tempest-keypair-722674119',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:18:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a18e542cdfb74711b0decf0c1f008e0b',ramdisk_id='',reservation_id='r-jwckp96f',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1842371167',owner_user_name='tempest-ServerActionsTestOtherB-1842371167-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e0d4b90694b09a71fc7790bb532df',uuid=e8b5ccab-5dff-4458-a799-8c8528a032b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-558718957-network", "vif_mac": "fa:16:3e:ba:1c:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converting VIF {"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-558718957-network", "vif_mac": "fa:16:3e:ba:1c:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:22:43 user nova-compute[72818]:   <uuid>e8b5ccab-5dff-4458-a799-8c8528a032b1</uuid>
Aug 17 21:22:43 user nova-compute[72818]:   <name>instance-0000000d</name>
Aug 17 21:22:43 user nova-compute[72818]:   <memory>2097152</memory>
Aug 17 21:22:43 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:22:43 user nova-compute[72818]:   <metadata>
Aug 17 21:22:43 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:22:43 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:22:43 user nova-compute[72818]:       <nova:name>tempest-ServerActionsTestOtherB-server-949986485</nova:name>
Aug 17 21:22:43 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:22:42</nova:creationTime>
Aug 17 21:22:43 user nova-compute[72818]:       <nova:flavor name="m1.small">
Aug 17 21:22:43 user nova-compute[72818]:         <nova:memory>2048</nova:memory>
Aug 17 21:22:43 user nova-compute[72818]:         <nova:disk>20</nova:disk>
Aug 17 21:22:43 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:22:43 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:22:43 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:22:43 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:22:43 user nova-compute[72818]:       <nova:owner>
Aug 17 21:22:43 user nova-compute[72818]:         <nova:user uuid="c20e0d4b90694b09a71fc7790bb532df">tempest-ServerActionsTestOtherB-1842371167-project-member</nova:user>
Aug 17 21:22:43 user nova-compute[72818]:         <nova:project uuid="a18e542cdfb74711b0decf0c1f008e0b">tempest-ServerActionsTestOtherB-1842371167</nova:project>
Aug 17 21:22:43 user nova-compute[72818]:       </nova:owner>
Aug 17 21:22:43 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:22:43 user nova-compute[72818]:       <nova:ports>
Aug 17 21:22:43 user nova-compute[72818]:         <nova:port uuid="25efe920-cfdf-428d-86ee-0f9b8f301e11">
Aug 17 21:22:43 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 21:22:43 user nova-compute[72818]:         </nova:port>
Aug 17 21:22:43 user nova-compute[72818]:       </nova:ports>
Aug 17 21:22:43 user nova-compute[72818]:     </nova:instance>
Aug 17 21:22:43 user nova-compute[72818]:   </metadata>
Aug 17 21:22:43 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:22:43 user nova-compute[72818]:     <system>
Aug 17 21:22:43 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:22:43 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:22:43 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:22:43 user nova-compute[72818]:       <entry name="serial">e8b5ccab-5dff-4458-a799-8c8528a032b1</entry>
Aug 17 21:22:43 user nova-compute[72818]:       <entry name="uuid">e8b5ccab-5dff-4458-a799-8c8528a032b1</entry>
Aug 17 21:22:43 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:22:43 user nova-compute[72818]:     </system>
Aug 17 21:22:43 user nova-compute[72818]:   </sysinfo>
Aug 17 21:22:43 user nova-compute[72818]:   <os>
Aug 17 21:22:43 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:22:43 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:22:43 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:22:43 user nova-compute[72818]:   </os>
Aug 17 21:22:43 user nova-compute[72818]:   <features>
Aug 17 21:22:43 user nova-compute[72818]:     <acpi/>
Aug 17 21:22:43 user nova-compute[72818]:     <apic/>
Aug 17 21:22:43 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:22:43 user nova-compute[72818]:   </features>
Aug 17 21:22:43 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:22:43 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:22:43 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:22:43 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:22:43 user nova-compute[72818]:   </clock>
Aug 17 21:22:43 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:22:43 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:22:43 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:22:43 user nova-compute[72818]:   </cpu>
Aug 17 21:22:43 user nova-compute[72818]:   <devices>
Aug 17 21:22:43 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:22:43 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:22:43 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk"/>
Aug 17 21:22:43 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:22:43 user nova-compute[72818]:     </disk>
Aug 17 21:22:43 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:22:43 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:22:43 user nova-compute[72818]:       <source dev="/dev/sdb"/>
Aug 17 21:22:43 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:22:43 user nova-compute[72818]:       <serial>943bedfa-18f9-40fc-a827-0e911837568b</serial>
Aug 17 21:22:43 user nova-compute[72818]:     </disk>
Aug 17 21:22:43 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:22:43 user nova-compute[72818]:       <mac address="fa:16:3e:ba:1c:1e"/>
Aug 17 21:22:43 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:22:43 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:22:43 user nova-compute[72818]:       <target dev="tap25efe920-cf"/>
Aug 17 21:22:43 user nova-compute[72818]:     </interface>
Aug 17 21:22:43 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:22:43 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/console.log" append="off"/>
Aug 17 21:22:43 user nova-compute[72818]:     </serial>
Aug 17 21:22:43 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:22:43 user nova-compute[72818]:     <video>
Aug 17 21:22:43 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:22:43 user nova-compute[72818]:     </video>
Aug 17 21:22:43 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:22:43 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:22:43 user nova-compute[72818]:     </rng>
Aug 17 21:22:43 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:22:43 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:22:43 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:22:43 user nova-compute[72818]:     </memballoon>
Aug 17 21:22:43 user nova-compute[72818]:   </devices>
Aug 17 21:22:43 user nova-compute[72818]: </domain>
Aug 17 21:22:43 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949986485',display_name='tempest-ServerActionsTestOtherB-server-949986485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949986485',id=13,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRc64wH9u6dm3xi4kk/wBQ/vGvOzR5k+mWwsr3HttVU/OU3wMLvrRNNKLA460//NVqERVsDyz6LYVlThM/1o9Ih8+/vljt/Rg70GDESbu8oCMaWXuSfr3pfnG0YVMizwg==',key_name='tempest-keypair-722674119',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:18:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a18e542cdfb74711b0decf0c1f008e0b',ramdisk_id='',reservation_id='r-jwckp96f',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1842371167',owner_user_name='tempest-ServerActionsTestOtherB-1842371167-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e0d4b90694b09a71fc7790bb532df',uuid=e8b5ccab-5dff-4458-a799-8c8528a032b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-558718957-network", "vif_mac": "fa:16:3e:ba:1c:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converting VIF {"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-558718957-network", "vif_mac": "fa:16:3e:ba:1c:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG os_vif [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25efe920-cf, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25efe920-cf, col_values=(('external_ids', {'iface-id': '25efe920-cfdf-428d-86ee-0f9b8f301e11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:1c:1e', 'vm-uuid': 'e8b5ccab-5dff-4458-a799-8c8528a032b1'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:43 user nova-compute[72818]: INFO os_vif [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf')
Aug 17 21:22:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:22:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] No VIF found with MAC fa:16:3e:ba:1c:1e, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:22:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-b9706f19-50b3-431d-93f3-fa38668c4a6c req-1b033f5d-3231-457c-9267-e991e2c31c9d service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b9706f19-50b3-431d-93f3-fa38668c4a6c req-1b033f5d-3231-457c-9267-e991e2c31c9d service nova] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b9706f19-50b3-431d-93f3-fa38668c4a6c req-1b033f5d-3231-457c-9267-e991e2c31c9d service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b9706f19-50b3-431d-93f3-fa38668c4a6c req-1b033f5d-3231-457c-9267-e991e2c31c9d service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-b9706f19-50b3-431d-93f3-fa38668c4a6c req-1b033f5d-3231-457c-9267-e991e2c31c9d service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] No waiting events found dispatching network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:22:45 user nova-compute[72818]: WARNING nova.compute.manager [req-b9706f19-50b3-431d-93f3-fa38668c4a6c req-1b033f5d-3231-457c-9267-e991e2c31c9d service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received unexpected event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 for instance with vm_state active and task_state resize_finish.
Aug 17 21:22:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:47 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307367.1626933, e8b5ccab-5dff-4458-a799-8c8528a032b1 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:22:47 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] VM Resumed (Lifecycle Event)
Aug 17 21:22:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:22:47 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance running successfully.
Aug 17 21:22:47 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Failed to set time: agent not configured {{(pid=72818) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 21:22:47 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f5a54218-1434-45ce-a8f2-c506a89b1730 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] finish_migration finished successfully. {{(pid=72818) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 21:22:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:22:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:22:47 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 21:22:47 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307367.1641886, e8b5ccab-5dff-4458-a799-8c8528a032b1 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:22:47 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] VM Started (Lifecycle Event)
Aug 17 21:22:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:22:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:22:47 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 21:22:47 user nova-compute[72818]: DEBUG nova.compute.manager [req-162e811c-57e9-4eaa-9454-4f6cebc1ad8c req-100f2722-aa09-4b1d-b0d1-87919241baf6 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-162e811c-57e9-4eaa-9454-4f6cebc1ad8c req-100f2722-aa09-4b1d-b0d1-87919241baf6 service nova] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-162e811c-57e9-4eaa-9454-4f6cebc1ad8c req-100f2722-aa09-4b1d-b0d1-87919241baf6 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-162e811c-57e9-4eaa-9454-4f6cebc1ad8c req-100f2722-aa09-4b1d-b0d1-87919241baf6 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:47 user nova-compute[72818]: DEBUG nova.compute.manager [req-162e811c-57e9-4eaa-9454-4f6cebc1ad8c req-100f2722-aa09-4b1d-b0d1-87919241baf6 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] No waiting events found dispatching network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:22:47 user nova-compute[72818]: WARNING nova.compute.manager [req-162e811c-57e9-4eaa-9454-4f6cebc1ad8c req-100f2722-aa09-4b1d-b0d1-87919241baf6 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received unexpected event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 for instance with vm_state resized and task_state None.
Aug 17 21:22:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "2be86065-3020-4d42-b1d2-000a50d96a82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "2be86065-3020-4d42-b1d2-000a50d96a82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:49 user nova-compute[72818]: DEBUG nova.compute.manager [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:22:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:49 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:22:49 user nova-compute[72818]: INFO nova.compute.claims [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Claim successful on node user
Aug 17 21:22:50 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:22:50 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:22:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:22:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:22:50 user nova-compute[72818]: DEBUG nova.network.neutron [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:22:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:22:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:22:50 user nova-compute[72818]: DEBUG nova.policy [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '721ba7982e32474aa2516493125fbf18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885c25f7a170493480c909f74b2188d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:22:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:22:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:22:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:22:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Creating image(s)
Aug 17 21:22:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "/opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "/opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "/opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.207s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk 1073741824" returned: 0 in 0.063s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG nova.network.neutron [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Successfully created port: e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Cannot resize image /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG nova.objects.instance [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lazy-loading 'migration_context' on Instance uuid 2be86065-3020-4d42-b1d2-000a50d96a82 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Ensure instance console log exists: /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:51 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Successfully updated port: e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "refresh_cache-2be86065-3020-4d42-b1d2-000a50d96a82" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquired lock "refresh_cache-2be86065-3020-4d42-b1d2-000a50d96a82" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.compute.manager [req-11c88ba2-4fc5-4424-b22e-fb4bf6f60103 req-b41a41b9-731a-4121-8b17-9ed5de965b64 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Received event network-changed-e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.compute.manager [req-11c88ba2-4fc5-4424-b22e-fb4bf6f60103 req-b41a41b9-731a-4121-8b17-9ed5de965b64 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Refreshing instance network info cache due to event network-changed-e09916d1-412a-4ee2-ba27-5b87c12cef2f. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-11c88ba2-4fc5-4424-b22e-fb4bf6f60103 req-b41a41b9-731a-4121-8b17-9ed5de965b64 service nova] Acquiring lock "refresh_cache-2be86065-3020-4d42-b1d2-000a50d96a82" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Updating instance_info_cache with network_info: [{"id": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "address": "fa:16:3e:c9:de:36", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09916d1-41", "ovs_interfaceid": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Releasing lock "refresh_cache-2be86065-3020-4d42-b1d2-000a50d96a82" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.compute.manager [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Instance network_info: |[{"id": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "address": "fa:16:3e:c9:de:36", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09916d1-41", "ovs_interfaceid": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-11c88ba2-4fc5-4424-b22e-fb4bf6f60103 req-b41a41b9-731a-4121-8b17-9ed5de965b64 service nova] Acquired lock "refresh_cache-2be86065-3020-4d42-b1d2-000a50d96a82" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.network.neutron [req-11c88ba2-4fc5-4424-b22e-fb4bf6f60103 req-b41a41b9-731a-4121-8b17-9ed5de965b64 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Refreshing network info cache for port e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Start _get_guest_xml network_info=[{"id": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "address": "fa:16:3e:c9:de:36", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09916d1-41", "ovs_interfaceid": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:22:52 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:22:52 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:22:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-913261563',display_name='tempest-ServersNegativeTestJSON-server-913261563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-913261563',id=21,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='885c25f7a170493480c909f74b2188d1',ramdisk_id='',reservation_id='r-yzq1giho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1481471081',owner_user_name='tempest-ServersNegativeTestJSON-1481471081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:22:51Z,user_data=None,user_id='721ba7982e32474aa2516493125fbf18',uuid=2be86065-3020-4d42-b1d2-000a50d96a82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "address": "fa:16:3e:c9:de:36", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09916d1-41", "ovs_interfaceid": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Converting VIF {"id": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "address": "fa:16:3e:c9:de:36", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09916d1-41", "ovs_interfaceid": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:de:36,bridge_name='br-int',has_traffic_filtering=True,id=e09916d1-412a-4ee2-ba27-5b87c12cef2f,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09916d1-41') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG nova.objects.instance [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lazy-loading 'pci_devices' on Instance uuid 2be86065-3020-4d42-b1d2-000a50d96a82 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:22:53 user nova-compute[72818]:   <uuid>2be86065-3020-4d42-b1d2-000a50d96a82</uuid>
Aug 17 21:22:53 user nova-compute[72818]:   <name>instance-00000015</name>
Aug 17 21:22:53 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:22:53 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:22:53 user nova-compute[72818]:   <metadata>
Aug 17 21:22:53 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:22:53 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:22:53 user nova-compute[72818]:       <nova:name>tempest-ServersNegativeTestJSON-server-913261563</nova:name>
Aug 17 21:22:53 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:22:52</nova:creationTime>
Aug 17 21:22:53 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:22:53 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:22:53 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:22:53 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:22:53 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:22:53 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:22:53 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:22:53 user nova-compute[72818]:       <nova:owner>
Aug 17 21:22:53 user nova-compute[72818]:         <nova:user uuid="721ba7982e32474aa2516493125fbf18">tempest-ServersNegativeTestJSON-1481471081-project-member</nova:user>
Aug 17 21:22:53 user nova-compute[72818]:         <nova:project uuid="885c25f7a170493480c909f74b2188d1">tempest-ServersNegativeTestJSON-1481471081</nova:project>
Aug 17 21:22:53 user nova-compute[72818]:       </nova:owner>
Aug 17 21:22:53 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:22:53 user nova-compute[72818]:       <nova:ports>
Aug 17 21:22:53 user nova-compute[72818]:         <nova:port uuid="e09916d1-412a-4ee2-ba27-5b87c12cef2f">
Aug 17 21:22:53 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 21:22:53 user nova-compute[72818]:         </nova:port>
Aug 17 21:22:53 user nova-compute[72818]:       </nova:ports>
Aug 17 21:22:53 user nova-compute[72818]:     </nova:instance>
Aug 17 21:22:53 user nova-compute[72818]:   </metadata>
Aug 17 21:22:53 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:22:53 user nova-compute[72818]:     <system>
Aug 17 21:22:53 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:22:53 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:22:53 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:22:53 user nova-compute[72818]:       <entry name="serial">2be86065-3020-4d42-b1d2-000a50d96a82</entry>
Aug 17 21:22:53 user nova-compute[72818]:       <entry name="uuid">2be86065-3020-4d42-b1d2-000a50d96a82</entry>
Aug 17 21:22:53 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:22:53 user nova-compute[72818]:     </system>
Aug 17 21:22:53 user nova-compute[72818]:   </sysinfo>
Aug 17 21:22:53 user nova-compute[72818]:   <os>
Aug 17 21:22:53 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:22:53 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:22:53 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:22:53 user nova-compute[72818]:   </os>
Aug 17 21:22:53 user nova-compute[72818]:   <features>
Aug 17 21:22:53 user nova-compute[72818]:     <acpi/>
Aug 17 21:22:53 user nova-compute[72818]:     <apic/>
Aug 17 21:22:53 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:22:53 user nova-compute[72818]:   </features>
Aug 17 21:22:53 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:22:53 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:22:53 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:22:53 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:22:53 user nova-compute[72818]:   </clock>
Aug 17 21:22:53 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:22:53 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:22:53 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:22:53 user nova-compute[72818]:   </cpu>
Aug 17 21:22:53 user nova-compute[72818]:   <devices>
Aug 17 21:22:53 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:22:53 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:22:53 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk"/>
Aug 17 21:22:53 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:22:53 user nova-compute[72818]:     </disk>
Aug 17 21:22:53 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:22:53 user nova-compute[72818]:       <mac address="fa:16:3e:c9:de:36"/>
Aug 17 21:22:53 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:22:53 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:22:53 user nova-compute[72818]:       <target dev="tape09916d1-41"/>
Aug 17 21:22:53 user nova-compute[72818]:     </interface>
Aug 17 21:22:53 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:22:53 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/console.log" append="off"/>
Aug 17 21:22:53 user nova-compute[72818]:     </serial>
Aug 17 21:22:53 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:22:53 user nova-compute[72818]:     <video>
Aug 17 21:22:53 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:22:53 user nova-compute[72818]:     </video>
Aug 17 21:22:53 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:22:53 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:22:53 user nova-compute[72818]:     </rng>
Aug 17 21:22:53 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:22:53 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:22:53 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:22:53 user nova-compute[72818]:     </memballoon>
Aug 17 21:22:53 user nova-compute[72818]:   </devices>
Aug 17 21:22:53 user nova-compute[72818]: </domain>
Aug 17 21:22:53 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-913261563',display_name='tempest-ServersNegativeTestJSON-server-913261563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-913261563',id=21,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='885c25f7a170493480c909f74b2188d1',ramdisk_id='',reservation_id='r-yzq1giho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1481471081',owner_user_name='tempest-ServersNegativeTestJSON-1481471081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:22:51Z,user_data=None,user_id='721ba7982e32474aa2516493125fbf18',uuid=2be86065-3020-4d42-b1d2-000a50d96a82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "address": "fa:16:3e:c9:de:36", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09916d1-41", "ovs_interfaceid": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Converting VIF {"id": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "address": "fa:16:3e:c9:de:36", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09916d1-41", "ovs_interfaceid": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:de:36,bridge_name='br-int',has_traffic_filtering=True,id=e09916d1-412a-4ee2-ba27-5b87c12cef2f,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09916d1-41') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG os_vif [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:de:36,bridge_name='br-int',has_traffic_filtering=True,id=e09916d1-412a-4ee2-ba27-5b87c12cef2f,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09916d1-41') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape09916d1-41, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape09916d1-41, col_values=(('external_ids', {'iface-id': 'e09916d1-412a-4ee2-ba27-5b87c12cef2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:de:36', 'vm-uuid': '2be86065-3020-4d42-b1d2-000a50d96a82'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:53 user nova-compute[72818]: INFO os_vif [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:de:36,bridge_name='br-int',has_traffic_filtering=True,id=e09916d1-412a-4ee2-ba27-5b87c12cef2f,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09916d1-41')
Aug 17 21:22:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] No VIF found with MAC fa:16:3e:c9:de:36, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:22:53 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG nova.network.neutron [req-11c88ba2-4fc5-4424-b22e-fb4bf6f60103 req-b41a41b9-731a-4121-8b17-9ed5de965b64 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Updated VIF entry in instance network info cache for port e09916d1-412a-4ee2-ba27-5b87c12cef2f. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG nova.network.neutron [req-11c88ba2-4fc5-4424-b22e-fb4bf6f60103 req-b41a41b9-731a-4121-8b17-9ed5de965b64 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Updating instance_info_cache with network_info: [{"id": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "address": "fa:16:3e:c9:de:36", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09916d1-41", "ovs_interfaceid": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-11c88ba2-4fc5-4424-b22e-fb4bf6f60103 req-b41a41b9-731a-4121-8b17-9ed5de965b64 service nova] Releasing lock "refresh_cache-2be86065-3020-4d42-b1d2-000a50d96a82" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoEyYQCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:22:54 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:22:54 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:22:54 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb65e06-384a-402d-81de-e7934c41a42a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:22:54 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8f509c-5e98-4871-81b6-33c82dc048a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c] added
Aug 17 21:22:54 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9706cb-464b-458f-835f-206f782b492e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Updating instance_info_cache with network_info: [{"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5ff4eb-055c-4e24-8203-5ce2a23b48fa]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uoEyYQCM {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uoEyYQCM" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e89679-8f1b-4fc9-825a-13c4c9d3b965]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uoEyYQCM'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8d288b-b0a9-4957-9516-1659755cf2b4]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd5854d-ff7a-4bb3-9c11-eee8e14b6814]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:54 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:22:54 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:54 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:22:54 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f4aa21-7f01-470f-a453-7d1c399a0383]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c, portal: 172.16.0.220,3260]
Aug 17 21:22:54 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c, portal: 172.16.0.220,3260] successful.
Aug 17 21:22:54 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b838ce8b-b8da-4e64-bd25-406a72883e5f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97deb2a-f195-4ba7-b5ff-affff3674be4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:54 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:22:54 user nova-compute[72818]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c (non-flash)
Aug 17 21:22:54 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:54 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:22:54 user nova-compute[72818]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c (non-flash)
Aug 17 21:22:54 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.038s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ae2e39-406c-4914-b327-a7a6a10f0f05]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:54 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-3d4d5e28-f48d-4e7c-bd1c-3532528bd1c4 req-32a87077-428d-4e2f-a4b7-b2277aef5c42 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Received event network-vif-plugged-e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3d4d5e28-f48d-4e7c-bd1c-3532528bd1c4 req-32a87077-428d-4e2f-a4b7-b2277aef5c42 service nova] Acquiring lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3d4d5e28-f48d-4e7c-bd1c-3532528bd1c4 req-32a87077-428d-4e2f-a4b7-b2277aef5c42 service nova] Lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3d4d5e28-f48d-4e7c-bd1c-3532528bd1c4 req-32a87077-428d-4e2f-a4b7-b2277aef5c42 service nova] Lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-3d4d5e28-f48d-4e7c-bd1c-3532528bd1c4 req-32a87077-428d-4e2f-a4b7-b2277aef5c42 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] No waiting events found dispatching network-vif-plugged-e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:22:55 user nova-compute[72818]: WARNING nova.compute.manager [req-3d4d5e28-f48d-4e7c-bd1c-3532528bd1c4 req-32a87077-428d-4e2f-a4b7-b2277aef5c42 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Received unexpected event network-vif-plugged-e09916d1-412a-4ee2-ba27-5b87c12cef2f for instance with vm_state building and task_state spawning.
Aug 17 21:22:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoEyYQCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '26230336461633466', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230336461633466', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG nova.objects.instance [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lazy-loading 'flavor' on Instance uuid be9e52eb-e0db-4b00-aa69-b8506b2275fe {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:22:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:22:55 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:22:55 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:22:55 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:22:55 user nova-compute[72818]:   <serial>4fd6e689-388a-4dc1-bc05-d08309530a7c</serial>
Aug 17 21:22:55 user nova-compute[72818]: </disk>
Aug 17 21:22:55 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:22:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:22:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:22:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] No VIF found with MAC fa:16:3e:82:95:1b, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:22:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-fd900013-93e0-46f4-8c64-90afe0a54ec1 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.117s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:56 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:22:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.compute.manager [req-fe45d14c-f3b2-41ae-bd47-09a46f04566d req-43b1a966-9475-4c10-90c4-8a372171ef8c service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Received event network-vif-plugged-e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fe45d14c-f3b2-41ae-bd47-09a46f04566d req-43b1a966-9475-4c10-90c4-8a372171ef8c service nova] Acquiring lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fe45d14c-f3b2-41ae-bd47-09a46f04566d req-43b1a966-9475-4c10-90c4-8a372171ef8c service nova] Lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fe45d14c-f3b2-41ae-bd47-09a46f04566d req-43b1a966-9475-4c10-90c4-8a372171ef8c service nova] Lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.compute.manager [req-fe45d14c-f3b2-41ae-bd47-09a46f04566d req-43b1a966-9475-4c10-90c4-8a372171ef8c service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] No waiting events found dispatching network-vif-plugged-e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:22:57 user nova-compute[72818]: WARNING nova.compute.manager [req-fe45d14c-f3b2-41ae-bd47-09a46f04566d req-43b1a966-9475-4c10-90c4-8a372171ef8c service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Received unexpected event network-vif-plugged-e09916d1-412a-4ee2-ba27-5b87c12cef2f for instance with vm_state building and task_state spawning.
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307377.1927028, 2be86065-3020-4d42-b1d2-000a50d96a82 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:22:57 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] VM Resumed (Lifecycle Event)
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:22:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Instance spawned successfully.
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:22:57 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307377.1984181, 2be86065-3020-4d42-b1d2-000a50d96a82 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:22:57 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] VM Started (Lifecycle Event)
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:22:57 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:22:57 user nova-compute[72818]: INFO nova.compute.manager [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Took 6.50 seconds to spawn the instance on the hypervisor.
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:22:57 user nova-compute[72818]: INFO nova.compute.manager [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Took 7.58 seconds to build instance.
Aug 17 21:22:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01093870-59a7-4e5c-b6ba-afcdc9f6ad42 tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "2be86065-3020-4d42-b1d2-000a50d96a82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.737s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:22:57 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:22:58 user nova-compute[72818]: INFO nova.compute.manager [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Detaching volume 4fd6e689-388a-4dc1-bc05-d08309530a7c
Aug 17 21:22:58 user nova-compute[72818]: INFO nova.virt.block_device [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Attempting to driver detach volume 4fd6e689-388a-4dc1-bc05-d08309530a7c from mountpoint /dev/vdb
Aug 17 21:22:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Attempting to detach device vdb from instance be9e52eb-e0db-4b00-aa69-b8506b2275fe from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:22:58 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:22:58 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:22:58 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:22:58 user nova-compute[72818]:   <serial>4fd6e689-388a-4dc1-bc05-d08309530a7c</serial>
Aug 17 21:22:58 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:22:58 user nova-compute[72818]: </disk>
Aug 17 21:22:58 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:22:58 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Successfully detached device vdb from instance be9e52eb-e0db-4b00-aa69-b8506b2275fe from the persistent domain config.
Aug 17 21:22:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be9e52eb-e0db-4b00-aa69-b8506b2275fe from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:22:58 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:22:58 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:22:58 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:22:58 user nova-compute[72818]:   <serial>4fd6e689-388a-4dc1-bc05-d08309530a7c</serial>
Aug 17 21:22:58 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:22:58 user nova-compute[72818]: </disk>
Aug 17 21:22:58 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692307378.780009, be9e52eb-e0db-4b00-aa69-b8506b2275fe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be9e52eb-e0db-4b00-aa69-b8506b2275fe {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:22:58 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Successfully detached device vdb from instance be9e52eb-e0db-4b00-aa69-b8506b2275fe from the live domain config.
Aug 17 21:22:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoEyYQCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:22:58 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:22:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b98b58-d177-4226-8586-460957a8af22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[806f605d-b8f9-43b5-b08e-04d8f6b37ef5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:58 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:22:58 user nova-compute[72818]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c (non-flash)
Aug 17 21:22:58 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:22:58 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:22:58 user nova-compute[72818]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c (non-flash)
Aug 17 21:22:58 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04dffd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c'): ({'sdc'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Removing single pathed devices sdc {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[58310fae-7aef-4cc5-adce-7de8274a624f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31c11b9-9496-423b-a13b-15497320e570]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Flushing IO for device /dev/sdc {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c9d47c-5eb1-4978-8660-7a93bdb69295]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1889dcd7-2a6a-4282-b490-b294c2361284]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e246e8c6-4b12-4f7f-8c3a-dcf441f31cfd]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2293af45-98fe-4aa3-b35d-091ef8fe0621]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c, portal: 172.16.0.220,3260]
Aug 17 21:22:59 user nova-compute[72818]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c, portal: 172.16.0.220,3260] successful.
Aug 17 21:22:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd6e689-388a-4dc1-bc05-d08309530a7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[485bb083-5123-4f1e-b1e3-7ca08cf8b112]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] <== disconnect_volume: return (292ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:22:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:00 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lazy-loading 'flavor' on Instance uuid be9e52eb-e0db-4b00-aa69-b8506b2275fe {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:23:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d331daea-aea7-405f-982e-449615f0a570 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.086s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:03 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:23:03 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7273MB free_disk=25.30440902709961GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Applying migration context for instance e8b5ccab-5dff-4458-a799-8c8528a032b1 as it has an incoming, in-progress migration 7b55f893-ec80-4bfa-beeb-8857fda52608. Migration status is finished {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 21:23:03 user nova-compute[72818]: INFO nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating resource usage from migration 7b55f893-ec80-4bfa-beeb-8857fda52608
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance be9e52eb-e0db-4b00-aa69-b8506b2275fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 774642dc-1888-4f4e-9485-b6dfe7ad6a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Migration 7b55f893-ec80-4bfa-beeb-8857fda52608 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e8b5ccab-5dff-4458-a799-8c8528a032b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 587af1f4-36d1-4bbd-a091-b42857ee8637 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 2be86065-3020-4d42-b1d2-000a50d96a82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:23:03 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:23:04 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:23:04 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:23:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:23:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:23:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:05 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:23:05 user nova-compute[72818]: INFO nova.compute.claims [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Claim successful on node user
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:23:06 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:23:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:23:06 user nova-compute[72818]: INFO nova.virt.block_device [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Booting with volume c4a67fd5-dd50-4a87-a413-fec308eb6f2f at /dev/vda
Aug 17 21:23:06 user nova-compute[72818]: DEBUG nova.policy [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '859bd4e053cd4fc6b7e6633afb107758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ddbaf2a03d4f14b7b7ca0096d05c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG os_brick.utils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ea6103-7f6c-4b89-a15b-eda30c1db638]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[220f5639-6f64-44c5-8918-0a4b7ad46ed2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[006f21ca-2dcd-40c0-b2f9-a73037db9c31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2473be94-781f-4ca7-8b27-498656d6db74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:23:06 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:23:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f64af0-2a10-4e45-9f80-029403bbab99]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG os_brick.utils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:23:06 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updating existing volume attachment record: c1150fc8-c337-4ab8-b8b4-76425d4f5d4b {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:23:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:07 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Successfully created port: 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Successfully updated port: 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquired lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-17845079-25c8-4032-b745-60eef05005da req-af902f75-b2a5-4997-83b5-10036b0b1ac2 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-changed-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-17845079-25c8-4032-b745-60eef05005da req-af902f75-b2a5-4997-83b5-10036b0b1ac2 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Refreshing instance network info cache due to event network-changed-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-17845079-25c8-4032-b745-60eef05005da req-af902f75-b2a5-4997-83b5-10036b0b1ac2 service nova] Acquiring lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updating instance_info_cache with network_info: [{"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Releasing lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Instance network_info: |[{"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-17845079-25c8-4032-b745-60eef05005da req-af902f75-b2a5-4997-83b5-10036b0b1ac2 service nova] Acquired lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG nova.network.neutron [req-17845079-25c8-4032-b745-60eef05005da req-af902f75-b2a5-4997-83b5-10036b0b1ac2 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Refreshing network info cache for port 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:23:08 user nova-compute[72818]: INFO nova.compute.claims [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Claim successful on node user
Aug 17 21:23:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG nova.network.neutron [req-17845079-25c8-4032-b745-60eef05005da req-af902f75-b2a5-4997-83b5-10036b0b1ac2 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updated VIF entry in instance network info cache for port 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG nova.network.neutron [req-17845079-25c8-4032-b745-60eef05005da req-af902f75-b2a5-4997-83b5-10036b0b1ac2 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updating instance_info_cache with network_info: [{"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-17845079-25c8-4032-b745-60eef05005da req-af902f75-b2a5-4997-83b5-10036b0b1ac2 service nova] Releasing lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG nova.network.neutron [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:23:09 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:23:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG nova.policy [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a35702dbbfa4620ac760c2dedfd5582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba1c61f7c2e4fd5a5a15bf69db27050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:23:09 user nova-compute[72818]: INFO nova.virt.block_device [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Booting with volume 1ab88003-1572-4052-a202-05a85d1904fc at /dev/vda
Aug 17 21:23:09 user nova-compute[72818]: DEBUG os_brick.utils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb790e0-361e-4c7b-819d-9fb1c6c33807]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae908436-a0f5-4060-a6a9-3508ca50ce21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0289a3d2-8208-4c8c-bc2b-9fb12fc01806]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb42a0ce-084c-4260-8c5d-93bd69068163]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:23:09 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:23:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d1db21-9780-4805-9a88-67882e0ec0b4]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG os_brick.utils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:23:09 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Updating existing volume attachment record: cb0349cc-9757-4dc2-9c49-e32c5002b457 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:23:10 user nova-compute[72818]: DEBUG nova.network.neutron [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Successfully created port: c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:23:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:11 user nova-compute[72818]: DEBUG nova.network.neutron [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Successfully updated port: c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:23:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "refresh_cache-9f46c1c0-c2b8-40cf-991f-c99735954429" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:23:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquired lock "refresh_cache-9f46c1c0-c2b8-40cf-991f-c99735954429" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:23:11 user nova-compute[72818]: DEBUG nova.network.neutron [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:23:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-660a9abf-1e2d-4faa-b9cc-ddcf91fcc08d req-0fb4809e-cc34-4335-b089-a938d3d1b4d9 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event network-changed-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-660a9abf-1e2d-4faa-b9cc-ddcf91fcc08d req-0fb4809e-cc34-4335-b089-a938d3d1b4d9 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Refreshing instance network info cache due to event network-changed-c0ef7f30-6392-41c4-9d25-03f33cf3766a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:23:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-660a9abf-1e2d-4faa-b9cc-ddcf91fcc08d req-0fb4809e-cc34-4335-b089-a938d3d1b4d9 service nova] Acquiring lock "refresh_cache-9f46c1c0-c2b8-40cf-991f-c99735954429" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:23:11 user nova-compute[72818]: DEBUG nova.network.neutron [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:23:12 user nova-compute[72818]: DEBUG nova.network.neutron [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Updating instance_info_cache with network_info: [{"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:23:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Releasing lock "refresh_cache-9f46c1c0-c2b8-40cf-991f-c99735954429" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:23:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Instance network_info: |[{"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:23:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-660a9abf-1e2d-4faa-b9cc-ddcf91fcc08d req-0fb4809e-cc34-4335-b089-a938d3d1b4d9 service nova] Acquired lock "refresh_cache-9f46c1c0-c2b8-40cf-991f-c99735954429" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:23:12 user nova-compute[72818]: DEBUG nova.network.neutron [req-660a9abf-1e2d-4faa-b9cc-ddcf91fcc08d req-0fb4809e-cc34-4335-b089-a938d3d1b4d9 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Refreshing network info cache for port c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:23:12 user nova-compute[72818]: DEBUG nova.network.neutron [req-660a9abf-1e2d-4faa-b9cc-ddcf91fcc08d req-0fb4809e-cc34-4335-b089-a938d3d1b4d9 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Updated VIF entry in instance network info cache for port c0ef7f30-6392-41c4-9d25-03f33cf3766a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:23:12 user nova-compute[72818]: DEBUG nova.network.neutron [req-660a9abf-1e2d-4faa-b9cc-ddcf91fcc08d req-0fb4809e-cc34-4335-b089-a938d3d1b4d9 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Updating instance_info_cache with network_info: [{"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:23:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-660a9abf-1e2d-4faa-b9cc-ddcf91fcc08d req-0fb4809e-cc34-4335-b089-a938d3d1b4d9 service nova] Releasing lock "refresh_cache-9f46c1c0-c2b8-40cf-991f-c99735954429" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:23:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:23:19 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Creating image(s)
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Ensure instance console log exists: /opt/stack/data/nova/instances/92f865e1-d261-47e3-a64d-dc7bc6e7a93f/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Start _get_guest_xml network_info=[{"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'c1150fc8-c337-4ab8-b8b4-76425d4f5d4b', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZVeHRuyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '92f865e1-d261-47e3-a64d-dc7bc6e7a93f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4a67fd5-dd50-4a87-a413-fec308eb6f2f', 'serial': 'c4a67fd5-dd50-4a87-a413-fec308eb6f2f'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:23:19 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:23:19 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZVeHRuyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:23:19 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:23:19 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:23:19 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[90830a19-6544-4578-8957-788eb683c388]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:23:19 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6d702e-27c4-4a79-b3e1-6cef148b134f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f] added
Aug 17 21:23:19 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f55625a-3cd7-4396-8d5e-3a5791e6f039]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f897e9-3b6b-4a78-a77b-fd4d3c262819]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZVeHRuyD {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZVeHRuyD" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbe8066-f3c5-4172-8bf4-37a1d3ffc019]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZVeHRuyD'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[50324a4d-515d-456b-bc42-fdd79ac16f94]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a34f6f-4632-4224-bc95-250750490eea]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:23:19 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:23:19 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:23:19 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:23:19 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c73144-f152-436c-bd89-0919abd8e8c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260]
Aug 17 21:23:19 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260] successful.
Aug 17 21:23:19 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbdd408-88ef-4310-b0d0-da6b73745329]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03a994a-de74-4f90-a758-8b49a80cf71b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:23:19 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:23:19 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:23:19 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:23:19 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:23:19 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:23:19 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f1d5bf-f908-445e-91d7-e5bcc93c311f]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:19 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZVeHRuyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23361373536306530', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361373536306530', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-722415076',display_name='tempest-TestShelveInstance-server-722415076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-722415076',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbPQv3z46gQnD4kxEjmUMxOixZmn4RDSrvj8X5ykYzwAOh9lGPQIyUa74vFa9YDsWg3lQ+Ldy4b84xgODAEdHo+3ZxHtuJ0Eqiefl9WxOeAXl0smQQSiJMBvhsgbOQE/Q==',key_name='tempest-TestShelveInstance-1267606421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30ddbaf2a03d4f14b7b7ca0096d05c4a',ramdisk_id='',reservation_id='r-k1p3u19l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-15245591',owner_user_name='tempest-TestShelveInstance-15245591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:23:07Z,user_data=None,user_id='859bd4e053cd4fc6b7e6633afb107758',uuid=92f865e1-d261-47e3-a64d-dc7bc6e7a93f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Converting VIF {"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lazy-loading 'pci_devices' on Instance uuid 92f865e1-d261-47e3-a64d-dc7bc6e7a93f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:23:20 user nova-compute[72818]:   <uuid>92f865e1-d261-47e3-a64d-dc7bc6e7a93f</uuid>
Aug 17 21:23:20 user nova-compute[72818]:   <name>instance-00000016</name>
Aug 17 21:23:20 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:23:20 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:23:20 user nova-compute[72818]:   <metadata>
Aug 17 21:23:20 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:23:20 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:23:20 user nova-compute[72818]:       <nova:name>tempest-TestShelveInstance-server-722415076</nova:name>
Aug 17 21:23:20 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:23:19</nova:creationTime>
Aug 17 21:23:20 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:23:20 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:23:20 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:23:20 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:23:20 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:23:20 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:23:20 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:23:20 user nova-compute[72818]:       <nova:owner>
Aug 17 21:23:20 user nova-compute[72818]:         <nova:user uuid="859bd4e053cd4fc6b7e6633afb107758">tempest-TestShelveInstance-15245591-project-member</nova:user>
Aug 17 21:23:20 user nova-compute[72818]:         <nova:project uuid="30ddbaf2a03d4f14b7b7ca0096d05c4a">tempest-TestShelveInstance-15245591</nova:project>
Aug 17 21:23:20 user nova-compute[72818]:       </nova:owner>
Aug 17 21:23:20 user nova-compute[72818]:       <nova:ports>
Aug 17 21:23:20 user nova-compute[72818]:         <nova:port uuid="11b6e8dd-b7be-4017-bf4a-1baf62da4e5a">
Aug 17 21:23:20 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 21:23:20 user nova-compute[72818]:         </nova:port>
Aug 17 21:23:20 user nova-compute[72818]:       </nova:ports>
Aug 17 21:23:20 user nova-compute[72818]:     </nova:instance>
Aug 17 21:23:20 user nova-compute[72818]:   </metadata>
Aug 17 21:23:20 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:23:20 user nova-compute[72818]:     <system>
Aug 17 21:23:20 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:23:20 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:23:20 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:23:20 user nova-compute[72818]:       <entry name="serial">92f865e1-d261-47e3-a64d-dc7bc6e7a93f</entry>
Aug 17 21:23:20 user nova-compute[72818]:       <entry name="uuid">92f865e1-d261-47e3-a64d-dc7bc6e7a93f</entry>
Aug 17 21:23:20 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:23:20 user nova-compute[72818]:     </system>
Aug 17 21:23:20 user nova-compute[72818]:   </sysinfo>
Aug 17 21:23:20 user nova-compute[72818]:   <os>
Aug 17 21:23:20 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:23:20 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:23:20 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:23:20 user nova-compute[72818]:   </os>
Aug 17 21:23:20 user nova-compute[72818]:   <features>
Aug 17 21:23:20 user nova-compute[72818]:     <acpi/>
Aug 17 21:23:20 user nova-compute[72818]:     <apic/>
Aug 17 21:23:20 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:23:20 user nova-compute[72818]:   </features>
Aug 17 21:23:20 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:23:20 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:23:20 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:23:20 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:23:20 user nova-compute[72818]:   </clock>
Aug 17 21:23:20 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:23:20 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:23:20 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:23:20 user nova-compute[72818]:   </cpu>
Aug 17 21:23:20 user nova-compute[72818]:   <devices>
Aug 17 21:23:20 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:23:20 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:23:20 user nova-compute[72818]:       <source dev="/dev/sdc"/>
Aug 17 21:23:20 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:23:20 user nova-compute[72818]:       <serial>c4a67fd5-dd50-4a87-a413-fec308eb6f2f</serial>
Aug 17 21:23:20 user nova-compute[72818]:     </disk>
Aug 17 21:23:20 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:23:20 user nova-compute[72818]:       <mac address="fa:16:3e:fb:b2:1a"/>
Aug 17 21:23:20 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:23:20 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:23:20 user nova-compute[72818]:       <target dev="tap11b6e8dd-b7"/>
Aug 17 21:23:20 user nova-compute[72818]:     </interface>
Aug 17 21:23:20 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:23:20 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/92f865e1-d261-47e3-a64d-dc7bc6e7a93f/console.log" append="off"/>
Aug 17 21:23:20 user nova-compute[72818]:     </serial>
Aug 17 21:23:20 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:23:20 user nova-compute[72818]:     <video>
Aug 17 21:23:20 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:23:20 user nova-compute[72818]:     </video>
Aug 17 21:23:20 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:23:20 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:23:20 user nova-compute[72818]:     </rng>
Aug 17 21:23:20 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:23:20 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:23:20 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:23:20 user nova-compute[72818]:     </memballoon>
Aug 17 21:23:20 user nova-compute[72818]:   </devices>
Aug 17 21:23:20 user nova-compute[72818]: </domain>
Aug 17 21:23:20 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-722415076',display_name='tempest-TestShelveInstance-server-722415076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-722415076',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbPQv3z46gQnD4kxEjmUMxOixZmn4RDSrvj8X5ykYzwAOh9lGPQIyUa74vFa9YDsWg3lQ+Ldy4b84xgODAEdHo+3ZxHtuJ0Eqiefl9WxOeAXl0smQQSiJMBvhsgbOQE/Q==',key_name='tempest-TestShelveInstance-1267606421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30ddbaf2a03d4f14b7b7ca0096d05c4a',ramdisk_id='',reservation_id='r-k1p3u19l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-15245591',owner_user_name='tempest-TestShelveInstance-15245591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:23:07Z,user_data=None,user_id='859bd4e053cd4fc6b7e6633afb107758',uuid=92f865e1-d261-47e3-a64d-dc7bc6e7a93f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Converting VIF {"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG os_vif [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11b6e8dd-b7, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11b6e8dd-b7, col_values=(('external_ids', {'iface-id': '11b6e8dd-b7be-4017-bf4a-1baf62da4e5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:b2:1a', 'vm-uuid': '92f865e1-d261-47e3-a64d-dc7bc6e7a93f'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:20 user nova-compute[72818]: INFO os_vif [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7')
Aug 17 21:23:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:23:20 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] No VIF found with MAC fa:16:3e:fb:b2:1a, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:23:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "6c46354a-2316-4703-b7fb-431fa37df1ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:23:22 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Creating image(s)
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Ensure instance console log exists: /opt/stack/data/nova/instances/9f46c1c0-c2b8-40cf-991f-c99735954429/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Start _get_guest_xml network_info=[{"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'cb0349cc-9757-4dc2-9c49-e32c5002b457', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frYIbUPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f46c1c0-c2b8-40cf-991f-c99735954429', 'attached_at': '', 'detached_at': '', 'volume_id': '1ab88003-1572-4052-a202-05a85d1904fc', 'serial': '1ab88003-1572-4052-a202-05a85d1904fc'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:22 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:23:22 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:23:22 user nova-compute[72818]: INFO nova.compute.claims [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Claim successful on node user
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frYIbUPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:23:22 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:23:22 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:23:22 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a87d319-b421-439f-8d53-9edd75c872eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:23:22 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5350d3a1-ec75-47a3-92b4-1fb4b8e603b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc] added
Aug 17 21:23:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8514acb-c90e-4458-8bf4-a1a089a27d85]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[449c937f-5ef8-4db9-aef0-a12d2b8b8c84]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frYIbUPh {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frYIbUPh" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0682f3d-3225-40e4-b72c-7850814516a4]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'frYIbUPh'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05a708e-8955-4790-ac6e-1b42475e0ed5]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2954689-49e5-4223-a7d6-0ecea97ff99c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:23:22 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:23:22 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:23:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:23:22 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:23:22 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:23:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-433a8fee-d5ad-46c1-9fd7-249aeee20f42 req-de591f3c-0825-4ff9-addc-d9ce7a92a9d9 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-433a8fee-d5ad-46c1-9fd7-249aeee20f42 req-de591f3c-0825-4ff9-addc-d9ce7a92a9d9 service nova] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-433a8fee-d5ad-46c1-9fd7-249aeee20f42 req-de591f3c-0825-4ff9-addc-d9ce7a92a9d9 service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-433a8fee-d5ad-46c1-9fd7-249aeee20f42 req-de591f3c-0825-4ff9-addc-d9ce7a92a9d9 service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-433a8fee-d5ad-46c1-9fd7-249aeee20f42 req-de591f3c-0825-4ff9-addc-d9ce7a92a9d9 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] No waiting events found dispatching network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:23:22 user nova-compute[72818]: WARNING nova.compute.manager [req-433a8fee-d5ad-46c1-9fd7-249aeee20f42 req-de591f3c-0825-4ff9-addc-d9ce7a92a9d9 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received unexpected event network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a for instance with vm_state building and task_state spawning.
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[471d703e-d693-4f70-9019-1c3d4e019826]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260]
Aug 17 21:23:22 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260] successful.
Aug 17 21:23:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9330ac-36bf-4472-a26d-85751e4977b2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[17195e8e-0afb-472a-bf58-6abf7de31eb0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:23:22 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:23:22 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:23:22 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:23:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:23:22 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:23:22 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:23:22 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:23:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[def18160-5071-4ce1-8838-a9c72916f5e7]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frYIbUPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:23:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.733s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.network.neutron [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:23:23 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.policy [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6cd1f219a2634975bb1362620392dc1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0b81a8a39436a9ec6e1646090f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:23:23 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Creating image(s)
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "/opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "/opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.188s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk 1073741824" returned: 0 in 0.061s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23739613362353566', 'path': '/dev/sdd'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739613362353566', 'path': '/dev/sdd'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2060472075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2060472075',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK9sJ2eq4o1JXfewQMshfkbC/kWFIvZxaJPcJLK3eMuQLLKsKNEtt9xLpxeN3txHMhagw7dYKiIeNu3aT7ClMUBqylRglK6VlcEfzYrHDU428DAM8IN/BPX4mbewJMS+Q==',key_name='tempest-keypair-741246036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ba1c61f7c2e4fd5a5a15bf69db27050',ramdisk_id='',reservation_id='r-rmts4810',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-329717180',owner_user_name='tempest-ServerActionsV293TestJSON-329717180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a35702dbbfa4620ac760c2dedfd5582',uuid=9f46c1c0-c2b8-40cf-991f-c99735954429,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Converting VIF {"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.objects.instance [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f46c1c0-c2b8-40cf-991f-c99735954429 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:23:23 user nova-compute[72818]:   <uuid>9f46c1c0-c2b8-40cf-991f-c99735954429</uuid>
Aug 17 21:23:23 user nova-compute[72818]:   <name>instance-00000017</name>
Aug 17 21:23:23 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:23:23 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:23:23 user nova-compute[72818]:   <metadata>
Aug 17 21:23:23 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:23:23 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:23:23 user nova-compute[72818]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2060472075</nova:name>
Aug 17 21:23:23 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:23:22</nova:creationTime>
Aug 17 21:23:23 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:23:23 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:23:23 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:23:23 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:23:23 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:23:23 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:23:23 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:23:23 user nova-compute[72818]:       <nova:owner>
Aug 17 21:23:23 user nova-compute[72818]:         <nova:user uuid="3a35702dbbfa4620ac760c2dedfd5582">tempest-ServerActionsV293TestJSON-329717180-project-member</nova:user>
Aug 17 21:23:23 user nova-compute[72818]:         <nova:project uuid="2ba1c61f7c2e4fd5a5a15bf69db27050">tempest-ServerActionsV293TestJSON-329717180</nova:project>
Aug 17 21:23:23 user nova-compute[72818]:       </nova:owner>
Aug 17 21:23:23 user nova-compute[72818]:       <nova:ports>
Aug 17 21:23:23 user nova-compute[72818]:         <nova:port uuid="c0ef7f30-6392-41c4-9d25-03f33cf3766a">
Aug 17 21:23:23 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 21:23:23 user nova-compute[72818]:         </nova:port>
Aug 17 21:23:23 user nova-compute[72818]:       </nova:ports>
Aug 17 21:23:23 user nova-compute[72818]:     </nova:instance>
Aug 17 21:23:23 user nova-compute[72818]:   </metadata>
Aug 17 21:23:23 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:23:23 user nova-compute[72818]:     <system>
Aug 17 21:23:23 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:23:23 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:23:23 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:23:23 user nova-compute[72818]:       <entry name="serial">9f46c1c0-c2b8-40cf-991f-c99735954429</entry>
Aug 17 21:23:23 user nova-compute[72818]:       <entry name="uuid">9f46c1c0-c2b8-40cf-991f-c99735954429</entry>
Aug 17 21:23:23 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:23:23 user nova-compute[72818]:     </system>
Aug 17 21:23:23 user nova-compute[72818]:   </sysinfo>
Aug 17 21:23:23 user nova-compute[72818]:   <os>
Aug 17 21:23:23 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:23:23 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:23:23 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:23:23 user nova-compute[72818]:   </os>
Aug 17 21:23:23 user nova-compute[72818]:   <features>
Aug 17 21:23:23 user nova-compute[72818]:     <acpi/>
Aug 17 21:23:23 user nova-compute[72818]:     <apic/>
Aug 17 21:23:23 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:23:23 user nova-compute[72818]:   </features>
Aug 17 21:23:23 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:23:23 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:23:23 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:23:23 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:23:23 user nova-compute[72818]:   </clock>
Aug 17 21:23:23 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:23:23 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:23:23 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:23:23 user nova-compute[72818]:   </cpu>
Aug 17 21:23:23 user nova-compute[72818]:   <devices>
Aug 17 21:23:23 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:23:23 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:23:23 user nova-compute[72818]:       <source dev="/dev/sdd"/>
Aug 17 21:23:23 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:23:23 user nova-compute[72818]:       <serial>1ab88003-1572-4052-a202-05a85d1904fc</serial>
Aug 17 21:23:23 user nova-compute[72818]:     </disk>
Aug 17 21:23:23 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:23:23 user nova-compute[72818]:       <mac address="fa:16:3e:c3:cc:b0"/>
Aug 17 21:23:23 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:23:23 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:23:23 user nova-compute[72818]:       <target dev="tapc0ef7f30-63"/>
Aug 17 21:23:23 user nova-compute[72818]:     </interface>
Aug 17 21:23:23 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:23:23 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/9f46c1c0-c2b8-40cf-991f-c99735954429/console.log" append="off"/>
Aug 17 21:23:23 user nova-compute[72818]:     </serial>
Aug 17 21:23:23 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:23:23 user nova-compute[72818]:     <video>
Aug 17 21:23:23 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:23:23 user nova-compute[72818]:     </video>
Aug 17 21:23:23 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:23:23 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:23:23 user nova-compute[72818]:     </rng>
Aug 17 21:23:23 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:23:23 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:23:23 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:23:23 user nova-compute[72818]:     </memballoon>
Aug 17 21:23:23 user nova-compute[72818]:   </devices>
Aug 17 21:23:23 user nova-compute[72818]: </domain>
Aug 17 21:23:23 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2060472075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2060472075',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK9sJ2eq4o1JXfewQMshfkbC/kWFIvZxaJPcJLK3eMuQLLKsKNEtt9xLpxeN3txHMhagw7dYKiIeNu3aT7ClMUBqylRglK6VlcEfzYrHDU428DAM8IN/BPX4mbewJMS+Q==',key_name='tempest-keypair-741246036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ba1c61f7c2e4fd5a5a15bf69db27050',ramdisk_id='',reservation_id='r-rmts4810',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-329717180',owner_user_name='tempest-ServerActionsV293TestJSON-329717180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a35702dbbfa4620ac760c2dedfd5582',uuid=9f46c1c0-c2b8-40cf-991f-c99735954429,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Converting VIF {"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG os_vif [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0ef7f30-63, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0ef7f30-63, col_values=(('external_ids', {'iface-id': 'c0ef7f30-6392-41c4-9d25-03f33cf3766a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:cc:b0', 'vm-uuid': '9f46c1c0-c2b8-40cf-991f-c99735954429'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:23 user nova-compute[72818]: INFO os_vif [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63')
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.198s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:23:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] No VIF found with MAC fa:16:3e:c3:cc:b0, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Successfully created port: 281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Cannot resize image /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.objects.instance [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'migration_context' on Instance uuid 6c46354a-2316-4703-b7fb-431fa37df1ab {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Ensure instance console log exists: /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307404.6159377, 92f865e1-d261-47e3-a64d-dc7bc6e7a93f => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:23:24 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] VM Resumed (Lifecycle Event)
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:23:24 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Instance spawned successfully.
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:24 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307404.6179173, 92f865e1-d261-47e3-a64d-dc7bc6e7a93f => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:23:24 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] VM Started (Lifecycle Event)
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-c5f36006-f394-4a21-bb56-7345e98b7022 req-f6077162-8a75-43e2-8825-9e64a8b0bb4d service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c5f36006-f394-4a21-bb56-7345e98b7022 req-f6077162-8a75-43e2-8825-9e64a8b0bb4d service nova] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c5f36006-f394-4a21-bb56-7345e98b7022 req-f6077162-8a75-43e2-8825-9e64a8b0bb4d service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c5f36006-f394-4a21-bb56-7345e98b7022 req-f6077162-8a75-43e2-8825-9e64a8b0bb4d service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-c5f36006-f394-4a21-bb56-7345e98b7022 req-f6077162-8a75-43e2-8825-9e64a8b0bb4d service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] No waiting events found dispatching network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:23:24 user nova-compute[72818]: WARNING nova.compute.manager [req-c5f36006-f394-4a21-bb56-7345e98b7022 req-f6077162-8a75-43e2-8825-9e64a8b0bb4d service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received unexpected event network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a for instance with vm_state building and task_state spawning.
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:23:24 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:23:24 user nova-compute[72818]: INFO nova.compute.manager [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Took 5.61 seconds to spawn the instance on the hypervisor.
Aug 17 21:23:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:23:24 user nova-compute[72818]: INFO nova.compute.manager [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Took 18.93 seconds to build instance.
Aug 17 21:23:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0de279e-e978-42b7-8e38-eea47218f6f8 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.041s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Successfully updated port: 281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "refresh_cache-6c46354a-2316-4703-b7fb-431fa37df1ab" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquired lock "refresh_cache-6c46354a-2316-4703-b7fb-431fa37df1ab" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.compute.manager [req-c1227811-8d1a-4344-bea9-b3269d89300c req-93e70ef2-573c-4934-97b2-2ab46975edf5 service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Received event network-changed-281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.compute.manager [req-c1227811-8d1a-4344-bea9-b3269d89300c req-93e70ef2-573c-4934-97b2-2ab46975edf5 service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Refreshing instance network info cache due to event network-changed-281c4ad0-fcb8-4031-8774-3e1f766ba8be. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c1227811-8d1a-4344-bea9-b3269d89300c req-93e70ef2-573c-4934-97b2-2ab46975edf5 service nova] Acquiring lock "refresh_cache-6c46354a-2316-4703-b7fb-431fa37df1ab" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Updating instance_info_cache with network_info: [{"id": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "address": "fa:16:3e:a5:cc:bb", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4ad0-fc", "ovs_interfaceid": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Releasing lock "refresh_cache-6c46354a-2316-4703-b7fb-431fa37df1ab" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Instance network_info: |[{"id": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "address": "fa:16:3e:a5:cc:bb", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4ad0-fc", "ovs_interfaceid": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c1227811-8d1a-4344-bea9-b3269d89300c req-93e70ef2-573c-4934-97b2-2ab46975edf5 service nova] Acquired lock "refresh_cache-6c46354a-2316-4703-b7fb-431fa37df1ab" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-c1227811-8d1a-4344-bea9-b3269d89300c req-93e70ef2-573c-4934-97b2-2ab46975edf5 service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Refreshing network info cache for port 281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Start _get_guest_xml network_info=[{"id": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "address": "fa:16:3e:a5:cc:bb", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4ad0-fc", "ovs_interfaceid": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:23:25 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:23:25 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-371834473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-371834473',id=24,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-54xrhgjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:23:23Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=6c46354a-2316-4703-b7fb-431fa37df1ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "address": "fa:16:3e:a5:cc:bb", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4ad0-fc", "ovs_interfaceid": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "address": "fa:16:3e:a5:cc:bb", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4ad0-fc", "ovs_interfaceid": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:bb,bridge_name='br-int',has_traffic_filtering=True,id=281c4ad0-fcb8-4031-8774-3e1f766ba8be,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4ad0-fc') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.objects.instance [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c46354a-2316-4703-b7fb-431fa37df1ab {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:23:25 user nova-compute[72818]:   <uuid>6c46354a-2316-4703-b7fb-431fa37df1ab</uuid>
Aug 17 21:23:25 user nova-compute[72818]:   <name>instance-00000018</name>
Aug 17 21:23:25 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:23:25 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:23:25 user nova-compute[72818]:   <metadata>
Aug 17 21:23:25 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:23:25 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:23:25 user nova-compute[72818]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-371834473</nova:name>
Aug 17 21:23:25 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:23:25</nova:creationTime>
Aug 17 21:23:25 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:23:25 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:23:25 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:23:25 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:23:25 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:23:25 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:23:25 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:23:25 user nova-compute[72818]:       <nova:owner>
Aug 17 21:23:25 user nova-compute[72818]:         <nova:user uuid="6cd1f219a2634975bb1362620392dc1a">tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member</nova:user>
Aug 17 21:23:25 user nova-compute[72818]:         <nova:project uuid="dda0b81a8a39436a9ec6e1646090f637">tempest-ServerBootFromVolumeStableRescueTest-1074783662</nova:project>
Aug 17 21:23:25 user nova-compute[72818]:       </nova:owner>
Aug 17 21:23:25 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:23:25 user nova-compute[72818]:       <nova:ports>
Aug 17 21:23:25 user nova-compute[72818]:         <nova:port uuid="281c4ad0-fcb8-4031-8774-3e1f766ba8be">
Aug 17 21:23:25 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 21:23:25 user nova-compute[72818]:         </nova:port>
Aug 17 21:23:25 user nova-compute[72818]:       </nova:ports>
Aug 17 21:23:25 user nova-compute[72818]:     </nova:instance>
Aug 17 21:23:25 user nova-compute[72818]:   </metadata>
Aug 17 21:23:25 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:23:25 user nova-compute[72818]:     <system>
Aug 17 21:23:25 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:23:25 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:23:25 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:23:25 user nova-compute[72818]:       <entry name="serial">6c46354a-2316-4703-b7fb-431fa37df1ab</entry>
Aug 17 21:23:25 user nova-compute[72818]:       <entry name="uuid">6c46354a-2316-4703-b7fb-431fa37df1ab</entry>
Aug 17 21:23:25 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:23:25 user nova-compute[72818]:     </system>
Aug 17 21:23:25 user nova-compute[72818]:   </sysinfo>
Aug 17 21:23:25 user nova-compute[72818]:   <os>
Aug 17 21:23:25 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:23:25 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:23:25 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:23:25 user nova-compute[72818]:   </os>
Aug 17 21:23:25 user nova-compute[72818]:   <features>
Aug 17 21:23:25 user nova-compute[72818]:     <acpi/>
Aug 17 21:23:25 user nova-compute[72818]:     <apic/>
Aug 17 21:23:25 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:23:25 user nova-compute[72818]:   </features>
Aug 17 21:23:25 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:23:25 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:23:25 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:23:25 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:23:25 user nova-compute[72818]:   </clock>
Aug 17 21:23:25 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:23:25 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:23:25 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:23:25 user nova-compute[72818]:   </cpu>
Aug 17 21:23:25 user nova-compute[72818]:   <devices>
Aug 17 21:23:25 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:23:25 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:23:25 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk"/>
Aug 17 21:23:25 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:23:25 user nova-compute[72818]:     </disk>
Aug 17 21:23:25 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:23:25 user nova-compute[72818]:       <mac address="fa:16:3e:a5:cc:bb"/>
Aug 17 21:23:25 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:23:25 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:23:25 user nova-compute[72818]:       <target dev="tap281c4ad0-fc"/>
Aug 17 21:23:25 user nova-compute[72818]:     </interface>
Aug 17 21:23:25 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:23:25 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/console.log" append="off"/>
Aug 17 21:23:25 user nova-compute[72818]:     </serial>
Aug 17 21:23:25 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:23:25 user nova-compute[72818]:     <video>
Aug 17 21:23:25 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:23:25 user nova-compute[72818]:     </video>
Aug 17 21:23:25 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:23:25 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:23:25 user nova-compute[72818]:     </rng>
Aug 17 21:23:25 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:23:25 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:23:25 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:23:25 user nova-compute[72818]:     </memballoon>
Aug 17 21:23:25 user nova-compute[72818]:   </devices>
Aug 17 21:23:25 user nova-compute[72818]: </domain>
Aug 17 21:23:25 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-371834473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-371834473',id=24,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-54xrhgjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:23:23Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=6c46354a-2316-4703-b7fb-431fa37df1ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "address": "fa:16:3e:a5:cc:bb", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4ad0-fc", "ovs_interfaceid": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "address": "fa:16:3e:a5:cc:bb", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4ad0-fc", "ovs_interfaceid": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:bb,bridge_name='br-int',has_traffic_filtering=True,id=281c4ad0-fcb8-4031-8774-3e1f766ba8be,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4ad0-fc') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG os_vif [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:bb,bridge_name='br-int',has_traffic_filtering=True,id=281c4ad0-fcb8-4031-8774-3e1f766ba8be,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4ad0-fc') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap281c4ad0-fc, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap281c4ad0-fc, col_values=(('external_ids', {'iface-id': '281c4ad0-fcb8-4031-8774-3e1f766ba8be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:cc:bb', 'vm-uuid': '6c46354a-2316-4703-b7fb-431fa37df1ab'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:23:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:25 user nova-compute[72818]: INFO os_vif [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:bb,bridge_name='br-int',has_traffic_filtering=True,id=281c4ad0-fcb8-4031-8774-3e1f766ba8be,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4ad0-fc')
Aug 17 21:23:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No VIF found with MAC fa:16:3e:a5:cc:bb, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-c1227811-8d1a-4344-bea9-b3269d89300c req-93e70ef2-573c-4934-97b2-2ab46975edf5 service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Updated VIF entry in instance network info cache for port 281c4ad0-fcb8-4031-8774-3e1f766ba8be. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-c1227811-8d1a-4344-bea9-b3269d89300c req-93e70ef2-573c-4934-97b2-2ab46975edf5 service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Updating instance_info_cache with network_info: [{"id": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "address": "fa:16:3e:a5:cc:bb", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4ad0-fc", "ovs_interfaceid": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c1227811-8d1a-4344-bea9-b3269d89300c req-93e70ef2-573c-4934-97b2-2ab46975edf5 service nova] Releasing lock "refresh_cache-6c46354a-2316-4703-b7fb-431fa37df1ab" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-48cdbf53-794a-4ca4-93c9-3d8abd07617b req-24b3b895-485f-4564-a0bb-6df7239da64c service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-48cdbf53-794a-4ca4-93c9-3d8abd07617b req-24b3b895-485f-4564-a0bb-6df7239da64c service nova] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-48cdbf53-794a-4ca4-93c9-3d8abd07617b req-24b3b895-485f-4564-a0bb-6df7239da64c service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-48cdbf53-794a-4ca4-93c9-3d8abd07617b req-24b3b895-485f-4564-a0bb-6df7239da64c service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-48cdbf53-794a-4ca4-93c9-3d8abd07617b req-24b3b895-485f-4564-a0bb-6df7239da64c service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] No waiting events found dispatching network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:23:26 user nova-compute[72818]: WARNING nova.compute.manager [req-48cdbf53-794a-4ca4-93c9-3d8abd07617b req-24b3b895-485f-4564-a0bb-6df7239da64c service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received unexpected event network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a for instance with vm_state building and task_state spawning.
Aug 17 21:23:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-48cdbf53-794a-4ca4-93c9-3d8abd07617b req-24b3b895-485f-4564-a0bb-6df7239da64c service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-48cdbf53-794a-4ca4-93c9-3d8abd07617b req-24b3b895-485f-4564-a0bb-6df7239da64c service nova] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-48cdbf53-794a-4ca4-93c9-3d8abd07617b req-24b3b895-485f-4564-a0bb-6df7239da64c service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-48cdbf53-794a-4ca4-93c9-3d8abd07617b req-24b3b895-485f-4564-a0bb-6df7239da64c service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-48cdbf53-794a-4ca4-93c9-3d8abd07617b req-24b3b895-485f-4564-a0bb-6df7239da64c service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] No waiting events found dispatching network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:23:26 user nova-compute[72818]: WARNING nova.compute.manager [req-48cdbf53-794a-4ca4-93c9-3d8abd07617b req-24b3b895-485f-4564-a0bb-6df7239da64c service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received unexpected event network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a for instance with vm_state building and task_state spawning.
Aug 17 21:23:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307408.100045, 9f46c1c0-c2b8-40cf-991f-c99735954429 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:23:28 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] VM Resumed (Lifecycle Event)
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:23:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Instance spawned successfully.
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:28 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307408.100501, 9f46c1c0-c2b8-40cf-991f-c99735954429 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:23:28 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] VM Started (Lifecycle Event)
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:23:28 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:23:28 user nova-compute[72818]: INFO nova.compute.manager [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Took 5.95 seconds to spawn the instance on the hypervisor.
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:23:28 user nova-compute[72818]: INFO nova.compute.manager [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Took 19.56 seconds to build instance.
Aug 17 21:23:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42ab8324-746f-40dd-90aa-1855a5de251f tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.717s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-883284f7-6d32-4b52-8baf-97093891cdef req-513480dc-eb84-4093-a6ee-fa83b37f7f1c service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Received event network-vif-plugged-281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-883284f7-6d32-4b52-8baf-97093891cdef req-513480dc-eb84-4093-a6ee-fa83b37f7f1c service nova] Acquiring lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-883284f7-6d32-4b52-8baf-97093891cdef req-513480dc-eb84-4093-a6ee-fa83b37f7f1c service nova] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-883284f7-6d32-4b52-8baf-97093891cdef req-513480dc-eb84-4093-a6ee-fa83b37f7f1c service nova] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-883284f7-6d32-4b52-8baf-97093891cdef req-513480dc-eb84-4093-a6ee-fa83b37f7f1c service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] No waiting events found dispatching network-vif-plugged-281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:23:28 user nova-compute[72818]: WARNING nova.compute.manager [req-883284f7-6d32-4b52-8baf-97093891cdef req-513480dc-eb84-4093-a6ee-fa83b37f7f1c service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Received unexpected event network-vif-plugged-281c4ad0-fcb8-4031-8774-3e1f766ba8be for instance with vm_state building and task_state spawning.
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-883284f7-6d32-4b52-8baf-97093891cdef req-513480dc-eb84-4093-a6ee-fa83b37f7f1c service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Received event network-vif-plugged-281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-883284f7-6d32-4b52-8baf-97093891cdef req-513480dc-eb84-4093-a6ee-fa83b37f7f1c service nova] Acquiring lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-883284f7-6d32-4b52-8baf-97093891cdef req-513480dc-eb84-4093-a6ee-fa83b37f7f1c service nova] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-883284f7-6d32-4b52-8baf-97093891cdef req-513480dc-eb84-4093-a6ee-fa83b37f7f1c service nova] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-883284f7-6d32-4b52-8baf-97093891cdef req-513480dc-eb84-4093-a6ee-fa83b37f7f1c service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] No waiting events found dispatching network-vif-plugged-281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:23:28 user nova-compute[72818]: WARNING nova.compute.manager [req-883284f7-6d32-4b52-8baf-97093891cdef req-513480dc-eb84-4093-a6ee-fa83b37f7f1c service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Received unexpected event network-vif-plugged-281c4ad0-fcb8-4031-8774-3e1f766ba8be for instance with vm_state building and task_state spawning.
Aug 17 21:23:29 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307409.9573884, 6c46354a-2316-4703-b7fb-431fa37df1ab => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:23:29 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] VM Resumed (Lifecycle Event)
Aug 17 21:23:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:23:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:23:29 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Instance spawned successfully.
Aug 17 21:23:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:23:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:23:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:23:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:23:30 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:23:30 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307409.9651592, 6c46354a-2316-4703-b7fb-431fa37df1ab => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:23:30 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] VM Started (Lifecycle Event)
Aug 17 21:23:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:23:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:23:30 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:23:30 user nova-compute[72818]: INFO nova.compute.manager [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Took 6.86 seconds to spawn the instance on the hypervisor.
Aug 17 21:23:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:23:30 user nova-compute[72818]: INFO nova.compute.manager [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Took 8.01 seconds to build instance.
Aug 17 21:23:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-04d96db6-eb5f-4758-bcd2-7c9f8f6e686a tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.128s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:23:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:23:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:23:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:23:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG nova.compute.manager [req-1f7ec628-e4e1-4053-ba0e-159642ff48b7 req-979f893d-9a56-459d-b27f-cc761368a265 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Received event network-changed-35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG nova.compute.manager [req-1f7ec628-e4e1-4053-ba0e-159642ff48b7 req-979f893d-9a56-459d-b27f-cc761368a265 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Refreshing instance network info cache due to event network-changed-35432717-090b-446d-b18d-10fd618b2cf9. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1f7ec628-e4e1-4053-ba0e-159642ff48b7 req-979f893d-9a56-459d-b27f-cc761368a265 service nova] Acquiring lock "refresh_cache-be9e52eb-e0db-4b00-aa69-b8506b2275fe" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1f7ec628-e4e1-4053-ba0e-159642ff48b7 req-979f893d-9a56-459d-b27f-cc761368a265 service nova] Acquired lock "refresh_cache-be9e52eb-e0db-4b00-aa69-b8506b2275fe" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG nova.network.neutron [req-1f7ec628-e4e1-4053-ba0e-159642ff48b7 req-979f893d-9a56-459d-b27f-cc761368a265 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Refreshing network info cache for port 35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:49 user nova-compute[72818]: INFO nova.compute.manager [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Terminating instance
Aug 17 21:23:49 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG nova.network.neutron [req-1f7ec628-e4e1-4053-ba0e-159642ff48b7 req-979f893d-9a56-459d-b27f-cc761368a265 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Updated VIF entry in instance network info cache for port 35432717-090b-446d-b18d-10fd618b2cf9. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG nova.network.neutron [req-1f7ec628-e4e1-4053-ba0e-159642ff48b7 req-979f893d-9a56-459d-b27f-cc761368a265 service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Updating instance_info_cache with network_info: [{"id": "35432717-090b-446d-b18d-10fd618b2cf9", "address": "fa:16:3e:82:95:1b", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35432717-09", "ovs_interfaceid": "35432717-090b-446d-b18d-10fd618b2cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:23:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1f7ec628-e4e1-4053-ba0e-159642ff48b7 req-979f893d-9a56-459d-b27f-cc761368a265 service nova] Releasing lock "refresh_cache-be9e52eb-e0db-4b00-aa69-b8506b2275fe" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:23:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Instance destroyed successfully.
Aug 17 21:23:50 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lazy-loading 'resources' on Instance uuid be9e52eb-e0db-4b00-aa69-b8506b2275fe {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:23:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1499227667',display_name='tempest-TestStampPattern-server-1499227667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1499227667',id=18,image_ref='62a86228-e660-482e-a794-cb6db417917c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOg12rwG0goFcEOqfjeVkLRdQHA4VYmkHTOdp9mo/FLMqnHH8awtzuou6HfZ30eiO4Lj+EDhkp42MExzTbcAj8c21NG1Hgsi9ewpnMwejZ3D3SuTfwK1a/C6Q0zNej4H8Q==',key_name='tempest-TestStampPattern-158492147',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:20:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ae77104eaa942eca3d579618e78ccc9',ramdisk_id='',reservation_id='r-j98fwc7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='48b00603-33ea-4eaa-b445-934ba1ab88f4',image_min_disk='1',image_min_ram='0',image_owner_id='0ae77104eaa942eca3d579618e78ccc9',image_owner_project_name='tempest-TestStampPattern-1752250551',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1752250551-project-member',image_user_id='790700df1c8549699854d5a0aa6e5566',owner_project_name='tempest-TestStampPattern-1752250551',owner_user_name='tempest-TestStampPattern-1752250551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:20:41Z,user_data=None,user_id='790700df1c8549699854d5a0aa6e5566',uuid=be9e52eb-e0db-4b00-aa69-b8506b2275fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35432717-090b-446d-b18d-10fd618b2cf9", "address": "fa:16:3e:82:95:1b", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35432717-09", "ovs_interfaceid": "35432717-090b-446d-b18d-10fd618b2cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:23:50 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Converting VIF {"id": "35432717-090b-446d-b18d-10fd618b2cf9", "address": "fa:16:3e:82:95:1b", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35432717-09", "ovs_interfaceid": "35432717-090b-446d-b18d-10fd618b2cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:23:50 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=35432717-090b-446d-b18d-10fd618b2cf9,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35432717-09') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:23:50 user nova-compute[72818]: DEBUG os_vif [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=35432717-090b-446d-b18d-10fd618b2cf9,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35432717-09') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:23:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35432717-09, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:23:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:23:50 user nova-compute[72818]: INFO os_vif [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:95:1b,bridge_name='br-int',has_traffic_filtering=True,id=35432717-090b-446d-b18d-10fd618b2cf9,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35432717-09')
Aug 17 21:23:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Deleting instance files /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe_del
Aug 17 21:23:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Deletion of /opt/stack/data/nova/instances/be9e52eb-e0db-4b00-aa69-b8506b2275fe_del complete
Aug 17 21:23:50 user nova-compute[72818]: INFO nova.compute.manager [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 17 21:23:50 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:23:50 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:23:50 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:23:50 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:23:50 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Took 0.53 seconds to deallocate network for instance.
Aug 17 21:23:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Received event network-vif-unplugged-35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] Acquiring lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] No waiting events found dispatching network-vif-unplugged-35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:23:51 user nova-compute[72818]: WARNING nova.compute.manager [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Received unexpected event network-vif-unplugged-35432717-090b-446d-b18d-10fd618b2cf9 for instance with vm_state deleted and task_state None.
Aug 17 21:23:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Received event network-vif-plugged-35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] Acquiring lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] No waiting events found dispatching network-vif-plugged-35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:23:51 user nova-compute[72818]: WARNING nova.compute.manager [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Received unexpected event network-vif-plugged-35432717-090b-446d-b18d-10fd618b2cf9 for instance with vm_state deleted and task_state None.
Aug 17 21:23:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-167a1ff3-6d5e-48ea-8b52-bcdc5786f664 req-8c852564-9477-4382-86e4-949fb3dfcded service nova] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Received event network-vif-deleted-35432717-090b-446d-b18d-10fd618b2cf9 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:51 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Deleted allocations for instance be9e52eb-e0db-4b00-aa69-b8506b2275fe
Aug 17 21:23:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8841f95e-a650-43cf-9121-00f05ea07467 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "be9e52eb-e0db-4b00-aa69-b8506b2275fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.351s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:52 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:23:52 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:23:52 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:23:53 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:23:54 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:23:54 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:23:54 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:23:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:23:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:23:54 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:23:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:55 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Updating instance_info_cache with network_info: [{"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:23:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:23:55 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:23:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:23:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:23:58 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:23:58 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:23:58 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:23:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:23:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:23:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:23:58 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:23:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:23:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:23:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:23:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:23:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG nova.compute.manager [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:24:01 user nova-compute[72818]: INFO nova.compute.claims [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Claim successful on node user
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG nova.network.neutron [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:24:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:24:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG nova.policy [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86cb8a969924487b8362d340d0bd31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5202a87dcf64b979cce5074783790f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:24:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Creating image(s)
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "/opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "/opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk 1073741824" returned: 0 in 0.093s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG nova.network.neutron [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Successfully created port: 9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.232s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Cannot resize image /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'migration_context' on Instance uuid 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Ensure instance console log exists: /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.network.neutron [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Successfully updated port: 9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-95fe08f3-76ae-4877-a2e8-78cd574a0c7c req-19ad2343-2f8b-40d9-b59e-27250f95f3c2 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-changed-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-95fe08f3-76ae-4877-a2e8-78cd574a0c7c req-19ad2343-2f8b-40d9-b59e-27250f95f3c2 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Refreshing instance network info cache due to event network-changed-9576b57c-48c9-4fe8-bfc8-17876b941e67. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-95fe08f3-76ae-4877-a2e8-78cd574a0c7c req-19ad2343-2f8b-40d9-b59e-27250f95f3c2 service nova] Acquiring lock "refresh_cache-8ab794f2-ef30-4524-8eea-224873d6f0b5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-95fe08f3-76ae-4877-a2e8-78cd574a0c7c req-19ad2343-2f8b-40d9-b59e-27250f95f3c2 service nova] Acquired lock "refresh_cache-8ab794f2-ef30-4524-8eea-224873d6f0b5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.network.neutron [req-95fe08f3-76ae-4877-a2e8-78cd574a0c7c req-19ad2343-2f8b-40d9-b59e-27250f95f3c2 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Refreshing network info cache for port 9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "refresh_cache-8ab794f2-ef30-4524-8eea-224873d6f0b5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:24:04 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:24:04 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=6715MB free_disk=25.224666595458984GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.network.neutron [req-95fe08f3-76ae-4877-a2e8-78cd574a0c7c req-19ad2343-2f8b-40d9-b59e-27250f95f3c2 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Applying migration context for instance e8b5ccab-5dff-4458-a799-8c8528a032b1 as it has an incoming, in-progress migration 7b55f893-ec80-4bfa-beeb-8857fda52608. Migration status is finished {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 21:24:04 user nova-compute[72818]: INFO nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating resource usage from migration 7b55f893-ec80-4bfa-beeb-8857fda52608
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 774642dc-1888-4f4e-9485-b6dfe7ad6a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Migration 7b55f893-ec80-4bfa-beeb-8857fda52608 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e8b5ccab-5dff-4458-a799-8c8528a032b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 587af1f4-36d1-4bbd-a091-b42857ee8637 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 2be86065-3020-4d42-b1d2-000a50d96a82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 92f865e1-d261-47e3-a64d-dc7bc6e7a93f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 9f46c1c0-c2b8-40cf-991f-c99735954429 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 6c46354a-2316-4703-b7fb-431fa37df1ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.network.neutron [req-95fe08f3-76ae-4877-a2e8-78cd574a0c7c req-19ad2343-2f8b-40d9-b59e-27250f95f3c2 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-95fe08f3-76ae-4877-a2e8-78cd574a0c7c req-19ad2343-2f8b-40d9-b59e-27250f95f3c2 service nova] Releasing lock "refresh_cache-8ab794f2-ef30-4524-8eea-224873d6f0b5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquired lock "refresh_cache-8ab794f2-ef30-4524-8eea-224873d6f0b5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.network.neutron [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.network.neutron [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.network.neutron [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Updating instance_info_cache with network_info: [{"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Releasing lock "refresh_cache-8ab794f2-ef30-4524-8eea-224873d6f0b5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Instance network_info: |[{"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Start _get_guest_xml network_info=[{"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:24:04 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:24:04 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1842332389',display_name='tempest-tempest.common.compute-instance-1842332389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1842332389',id=25,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLocLU8TRDAiLi3GdKktq0nWqdk7D1keSlsLXc1XBv8DJ5eY9kzsxQScXcrArgHMHu1A1J4D/TdCnI8XhIYNw2UvB+RykgPVyRzvdlRj00o3UKrPopaD5xejUX+15fusg==',key_name='tempest-keypair-904493785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-igol0v2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:24:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=8ab794f2-ef30-4524-8eea-224873d6f0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.objects.instance [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:24:04 user nova-compute[72818]:   <uuid>8ab794f2-ef30-4524-8eea-224873d6f0b5</uuid>
Aug 17 21:24:04 user nova-compute[72818]:   <name>instance-00000019</name>
Aug 17 21:24:04 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:24:04 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:24:04 user nova-compute[72818]:   <metadata>
Aug 17 21:24:04 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:24:04 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:24:04 user nova-compute[72818]:       <nova:name>tempest-tempest.common.compute-instance-1842332389</nova:name>
Aug 17 21:24:04 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:24:04</nova:creationTime>
Aug 17 21:24:04 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:24:04 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:24:04 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:24:04 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:24:04 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:24:04 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:24:04 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:24:04 user nova-compute[72818]:       <nova:owner>
Aug 17 21:24:04 user nova-compute[72818]:         <nova:user uuid="86cb8a969924487b8362d340d0bd31b5">tempest-ServerActionsTestOtherA-1230434837-project-member</nova:user>
Aug 17 21:24:04 user nova-compute[72818]:         <nova:project uuid="d5202a87dcf64b979cce5074783790f9">tempest-ServerActionsTestOtherA-1230434837</nova:project>
Aug 17 21:24:04 user nova-compute[72818]:       </nova:owner>
Aug 17 21:24:04 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:24:04 user nova-compute[72818]:       <nova:ports>
Aug 17 21:24:04 user nova-compute[72818]:         <nova:port uuid="9576b57c-48c9-4fe8-bfc8-17876b941e67">
Aug 17 21:24:04 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 21:24:04 user nova-compute[72818]:         </nova:port>
Aug 17 21:24:04 user nova-compute[72818]:       </nova:ports>
Aug 17 21:24:04 user nova-compute[72818]:     </nova:instance>
Aug 17 21:24:04 user nova-compute[72818]:   </metadata>
Aug 17 21:24:04 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:24:04 user nova-compute[72818]:     <system>
Aug 17 21:24:04 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:24:04 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:24:04 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:24:04 user nova-compute[72818]:       <entry name="serial">8ab794f2-ef30-4524-8eea-224873d6f0b5</entry>
Aug 17 21:24:04 user nova-compute[72818]:       <entry name="uuid">8ab794f2-ef30-4524-8eea-224873d6f0b5</entry>
Aug 17 21:24:04 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:24:04 user nova-compute[72818]:     </system>
Aug 17 21:24:04 user nova-compute[72818]:   </sysinfo>
Aug 17 21:24:04 user nova-compute[72818]:   <os>
Aug 17 21:24:04 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:24:04 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:24:04 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:24:04 user nova-compute[72818]:   </os>
Aug 17 21:24:04 user nova-compute[72818]:   <features>
Aug 17 21:24:04 user nova-compute[72818]:     <acpi/>
Aug 17 21:24:04 user nova-compute[72818]:     <apic/>
Aug 17 21:24:04 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:24:04 user nova-compute[72818]:   </features>
Aug 17 21:24:04 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:24:04 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:24:04 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:24:04 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:24:04 user nova-compute[72818]:   </clock>
Aug 17 21:24:04 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:24:04 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:24:04 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:24:04 user nova-compute[72818]:   </cpu>
Aug 17 21:24:04 user nova-compute[72818]:   <devices>
Aug 17 21:24:04 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:24:04 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:24:04 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk"/>
Aug 17 21:24:04 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:24:04 user nova-compute[72818]:     </disk>
Aug 17 21:24:04 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:24:04 user nova-compute[72818]:       <mac address="fa:16:3e:61:46:e5"/>
Aug 17 21:24:04 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:24:04 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:24:04 user nova-compute[72818]:       <target dev="tap9576b57c-48"/>
Aug 17 21:24:04 user nova-compute[72818]:     </interface>
Aug 17 21:24:04 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:24:04 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/console.log" append="off"/>
Aug 17 21:24:04 user nova-compute[72818]:     </serial>
Aug 17 21:24:04 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:24:04 user nova-compute[72818]:     <video>
Aug 17 21:24:04 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:24:04 user nova-compute[72818]:     </video>
Aug 17 21:24:04 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:24:04 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:24:04 user nova-compute[72818]:     </rng>
Aug 17 21:24:04 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:24:04 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:24:04 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:24:04 user nova-compute[72818]:     </memballoon>
Aug 17 21:24:04 user nova-compute[72818]:   </devices>
Aug 17 21:24:04 user nova-compute[72818]: </domain>
Aug 17 21:24:04 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1842332389',display_name='tempest-tempest.common.compute-instance-1842332389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1842332389',id=25,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLocLU8TRDAiLi3GdKktq0nWqdk7D1keSlsLXc1XBv8DJ5eY9kzsxQScXcrArgHMHu1A1J4D/TdCnI8XhIYNw2UvB+RykgPVyRzvdlRj00o3UKrPopaD5xejUX+15fusg==',key_name='tempest-keypair-904493785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-igol0v2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:24:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=8ab794f2-ef30-4524-8eea-224873d6f0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG os_vif [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9576b57c-48, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9576b57c-48, col_values=(('external_ids', {'iface-id': '9576b57c-48c9-4fe8-bfc8-17876b941e67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:46:e5', 'vm-uuid': '8ab794f2-ef30-4524-8eea-224873d6f0b5'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:05 user nova-compute[72818]: INFO os_vif [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48')
Aug 17 21:24:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] No VIF found with MAC fa:16:3e:61:46:e5, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:24:05 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307430.2046986, be9e52eb-e0db-4b00-aa69-b8506b2275fe => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:24:05 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] VM Stopped (Lifecycle Event)
Aug 17 21:24:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-9e558455-4e4f-4cc0-9611-c88a81433390 None None] [instance: be9e52eb-e0db-4b00-aa69-b8506b2275fe] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:24:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-c7a0fc4b-0752-425a-840e-ef09db423270 req-36fa85ca-c50c-4b2f-a1bf-72f5d5065349 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c7a0fc4b-0752-425a-840e-ef09db423270 req-36fa85ca-c50c-4b2f-a1bf-72f5d5065349 service nova] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c7a0fc4b-0752-425a-840e-ef09db423270 req-36fa85ca-c50c-4b2f-a1bf-72f5d5065349 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c7a0fc4b-0752-425a-840e-ef09db423270 req-36fa85ca-c50c-4b2f-a1bf-72f5d5065349 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-c7a0fc4b-0752-425a-840e-ef09db423270 req-36fa85ca-c50c-4b2f-a1bf-72f5d5065349 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] No waiting events found dispatching network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:06 user nova-compute[72818]: WARNING nova.compute.manager [req-c7a0fc4b-0752-425a-840e-ef09db423270 req-36fa85ca-c50c-4b2f-a1bf-72f5d5065349 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received unexpected event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 for instance with vm_state building and task_state spawning.
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307448.6054544, 8ab794f2-ef30-4524-8eea-224873d6f0b5 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:24:08 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] VM Resumed (Lifecycle Event)
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:24:08 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Instance spawned successfully.
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:24:08 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307448.606813, 8ab794f2-ef30-4524-8eea-224873d6f0b5 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:24:08 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] VM Started (Lifecycle Event)
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:24:08 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:24:08 user nova-compute[72818]: INFO nova.compute.manager [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ce7f9f45-2aba-4b22-a5ca-f510df39a535 req-7c2d47b9-dfb4-45ba-a462-4adb6a5652a4 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ce7f9f45-2aba-4b22-a5ca-f510df39a535 req-7c2d47b9-dfb4-45ba-a462-4adb6a5652a4 service nova] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ce7f9f45-2aba-4b22-a5ca-f510df39a535 req-7c2d47b9-dfb4-45ba-a462-4adb6a5652a4 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ce7f9f45-2aba-4b22-a5ca-f510df39a535 req-7c2d47b9-dfb4-45ba-a462-4adb6a5652a4 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ce7f9f45-2aba-4b22-a5ca-f510df39a535 req-7c2d47b9-dfb4-45ba-a462-4adb6a5652a4 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] No waiting events found dispatching network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:08 user nova-compute[72818]: WARNING nova.compute.manager [req-ce7f9f45-2aba-4b22-a5ca-f510df39a535 req-7c2d47b9-dfb4-45ba-a462-4adb6a5652a4 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received unexpected event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 for instance with vm_state building and task_state spawning.
Aug 17 21:24:08 user nova-compute[72818]: INFO nova.compute.manager [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Took 7.17 seconds to build instance.
Aug 17 21:24:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-05232f20-24e8-4834-b6d9-206b1ac153dd tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.264s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:09 user nova-compute[72818]: INFO nova.compute.manager [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Rescuing
Aug 17 21:24:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:24:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquired lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:24:09 user nova-compute[72818]: DEBUG nova.network.neutron [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG nova.network.neutron [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Updating instance_info_cache with network_info: [{"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Releasing lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-fc6285da-d3c9-4c0f-9c3f-f72193febca4 req-5c3af02f-6003-4016-8420-cf775bd42563 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-unplugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc6285da-d3c9-4c0f-9c3f-f72193febca4 req-5c3af02f-6003-4016-8420-cf775bd42563 service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc6285da-d3c9-4c0f-9c3f-f72193febca4 req-5c3af02f-6003-4016-8420-cf775bd42563 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc6285da-d3c9-4c0f-9c3f-f72193febca4 req-5c3af02f-6003-4016-8420-cf775bd42563 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-fc6285da-d3c9-4c0f-9c3f-f72193febca4 req-5c3af02f-6003-4016-8420-cf775bd42563 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-unplugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:10 user nova-compute[72818]: WARNING nova.compute.manager [req-fc6285da-d3c9-4c0f-9c3f-f72193febca4 req-5c3af02f-6003-4016-8420-cf775bd42563 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-unplugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state active and task_state rescuing.
Aug 17 21:24:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:10 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Instance destroyed successfully.
Aug 17 21:24:10 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Attempting rescue
Aug 17 21:24:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72818) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Instance directory exists: not creating {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 21:24:10 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Creating image(s)
Aug 17 21:24:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "/opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "/opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG nova.objects.instance [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4b43de5d-62c1-4368-8a77-59899ae0b16d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.rescue {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.rescue" returned: 0 in 0.047s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.objects.instance [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'migration_context' on Instance uuid 4b43de5d-62c1-4368-8a77-59899ae0b16d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Start _get_guest_xml network_info=[{"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "vif_mac": "fa:16:3e:de:61:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.objects.instance [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'resources' on Instance uuid 4b43de5d-62c1-4368-8a77-59899ae0b16d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.objects.instance [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b43de5d-62c1-4368-8a77-59899ae0b16d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:11 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:24:11 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.objects.instance [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b43de5d-62c1-4368-8a77-59899ae0b16d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-688622221',display_name='tempest-ServerRescueNegativeTestJSON-server-688622221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-688622221',id=15,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f6bdddb43364e86b302c9c2e273fd44',ramdisk_id='',reservation_id='r-ek70jhb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-713886303',owner_user_name='tempest-ServerRescueNegativeTestJSON-713886303-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:19:32Z,user_data=None,user_id='8ffa40080d9842b1a4f6a3e041b5d123',uuid=4b43de5d-62c1-4368-8a77-59899ae0b16d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "vif_mac": "fa:16:3e:de:61:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converting VIF {"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "vif_mac": "fa:16:3e:de:61:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:61:a7,bridge_name='br-int',has_traffic_filtering=True,id=73bea181-5987-4935-af5c-9f87b135d933,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bea181-59') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.objects.instance [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b43de5d-62c1-4368-8a77-59899ae0b16d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:24:11 user nova-compute[72818]:   <uuid>4b43de5d-62c1-4368-8a77-59899ae0b16d</uuid>
Aug 17 21:24:11 user nova-compute[72818]:   <name>instance-0000000f</name>
Aug 17 21:24:11 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:24:11 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:24:11 user nova-compute[72818]:   <metadata>
Aug 17 21:24:11 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:24:11 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:24:11 user nova-compute[72818]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-688622221</nova:name>
Aug 17 21:24:11 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:24:11</nova:creationTime>
Aug 17 21:24:11 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:24:11 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:24:11 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:24:11 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:24:11 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:24:11 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:24:11 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:24:11 user nova-compute[72818]:       <nova:owner>
Aug 17 21:24:11 user nova-compute[72818]:         <nova:user uuid="8ffa40080d9842b1a4f6a3e041b5d123">tempest-ServerRescueNegativeTestJSON-713886303-project-member</nova:user>
Aug 17 21:24:11 user nova-compute[72818]:         <nova:project uuid="7f6bdddb43364e86b302c9c2e273fd44">tempest-ServerRescueNegativeTestJSON-713886303</nova:project>
Aug 17 21:24:11 user nova-compute[72818]:       </nova:owner>
Aug 17 21:24:11 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:24:11 user nova-compute[72818]:       <nova:ports>
Aug 17 21:24:11 user nova-compute[72818]:         <nova:port uuid="73bea181-5987-4935-af5c-9f87b135d933">
Aug 17 21:24:11 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 21:24:11 user nova-compute[72818]:         </nova:port>
Aug 17 21:24:11 user nova-compute[72818]:       </nova:ports>
Aug 17 21:24:11 user nova-compute[72818]:     </nova:instance>
Aug 17 21:24:11 user nova-compute[72818]:   </metadata>
Aug 17 21:24:11 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:24:11 user nova-compute[72818]:     <system>
Aug 17 21:24:11 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:24:11 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:24:11 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:24:11 user nova-compute[72818]:       <entry name="serial">4b43de5d-62c1-4368-8a77-59899ae0b16d</entry>
Aug 17 21:24:11 user nova-compute[72818]:       <entry name="uuid">4b43de5d-62c1-4368-8a77-59899ae0b16d</entry>
Aug 17 21:24:11 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:24:11 user nova-compute[72818]:     </system>
Aug 17 21:24:11 user nova-compute[72818]:   </sysinfo>
Aug 17 21:24:11 user nova-compute[72818]:   <os>
Aug 17 21:24:11 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:24:11 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:24:11 user nova-compute[72818]:   </os>
Aug 17 21:24:11 user nova-compute[72818]:   <features>
Aug 17 21:24:11 user nova-compute[72818]:     <acpi/>
Aug 17 21:24:11 user nova-compute[72818]:     <apic/>
Aug 17 21:24:11 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:24:11 user nova-compute[72818]:   </features>
Aug 17 21:24:11 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:24:11 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:24:11 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:24:11 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:24:11 user nova-compute[72818]:   </clock>
Aug 17 21:24:11 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:24:11 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:24:11 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:24:11 user nova-compute[72818]:   </cpu>
Aug 17 21:24:11 user nova-compute[72818]:   <devices>
Aug 17 21:24:11 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:24:11 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:24:11 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.rescue"/>
Aug 17 21:24:11 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:24:11 user nova-compute[72818]:     </disk>
Aug 17 21:24:11 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:24:11 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:24:11 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk"/>
Aug 17 21:24:11 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:24:11 user nova-compute[72818]:     </disk>
Aug 17 21:24:11 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:24:11 user nova-compute[72818]:       <mac address="fa:16:3e:de:61:a7"/>
Aug 17 21:24:11 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:24:11 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:24:11 user nova-compute[72818]:       <target dev="tap73bea181-59"/>
Aug 17 21:24:11 user nova-compute[72818]:     </interface>
Aug 17 21:24:11 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:24:11 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/console.log" append="off"/>
Aug 17 21:24:11 user nova-compute[72818]:     </serial>
Aug 17 21:24:11 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:24:11 user nova-compute[72818]:     <video>
Aug 17 21:24:11 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:24:11 user nova-compute[72818]:     </video>
Aug 17 21:24:11 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:24:11 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:24:11 user nova-compute[72818]:     </rng>
Aug 17 21:24:11 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:24:11 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:24:11 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:24:11 user nova-compute[72818]:     </memballoon>
Aug 17 21:24:11 user nova-compute[72818]:   </devices>
Aug 17 21:24:11 user nova-compute[72818]: </domain>
Aug 17 21:24:11 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:24:11 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Instance destroyed successfully.
Aug 17 21:24:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No VIF found with MAC fa:16:3e:de:61:a7, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:12 user nova-compute[72818]: WARNING nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state active and task_state rescuing.
Aug 17 21:24:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:12 user nova-compute[72818]: WARNING nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state active and task_state rescuing.
Aug 17 21:24:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:12 user nova-compute[72818]: WARNING nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state active and task_state rescuing.
Aug 17 21:24:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-unplugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-unplugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:12 user nova-compute[72818]: WARNING nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-unplugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state active and task_state rescuing.
Aug 17 21:24:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:12 user nova-compute[72818]: WARNING nova.compute.manager [req-45ea4ce0-3650-42fe-914b-fade1094ecf2 req-1e535839-be9b-4a1d-b2e8-5f9d37344e2c service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state active and task_state rescuing.
Aug 17 21:24:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:13 user nova-compute[72818]: DEBUG nova.network.neutron [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Port 25efe920-cfdf-428d-86ee-0f9b8f301e11 binding to destination host user is already ACTIVE {{(pid=72818) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 21:24:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:24:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquired lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:24:13 user nova-compute[72818]: DEBUG nova.network.neutron [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:24:13 user nova-compute[72818]: DEBUG nova.network.neutron [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating instance_info_cache with network_info: [{"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:24:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Releasing lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Creating tmpfile /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/tmp2pntzj89 to verify with other compute node that the instance is on the same shared storage. {{(pid=72818) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-249c963f-8871-4788-b175-a1dabe3730f2 req-df8b9c07-3671-45b2-9a76-fc1c9efc94d0 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-unplugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-249c963f-8871-4788-b175-a1dabe3730f2 req-df8b9c07-3671-45b2-9a76-fc1c9efc94d0 service nova] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-249c963f-8871-4788-b175-a1dabe3730f2 req-df8b9c07-3671-45b2-9a76-fc1c9efc94d0 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-249c963f-8871-4788-b175-a1dabe3730f2 req-df8b9c07-3671-45b2-9a76-fc1c9efc94d0 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-249c963f-8871-4788-b175-a1dabe3730f2 req-df8b9c07-3671-45b2-9a76-fc1c9efc94d0 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] No waiting events found dispatching network-vif-unplugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:14 user nova-compute[72818]: WARNING nova.compute.manager [req-249c963f-8871-4788-b175-a1dabe3730f2 req-df8b9c07-3671-45b2-9a76-fc1c9efc94d0 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received unexpected event network-vif-unplugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 for instance with vm_state resized and task_state resize_reverting.
Aug 17 21:24:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-2357d268-1b9a-4fb0-8290-11bc6c5edf99 req-6831e68a-41d6-49e6-8bbb-ffd1e7d219d1 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2357d268-1b9a-4fb0-8290-11bc6c5edf99 req-6831e68a-41d6-49e6-8bbb-ffd1e7d219d1 service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2357d268-1b9a-4fb0-8290-11bc6c5edf99 req-6831e68a-41d6-49e6-8bbb-ffd1e7d219d1 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2357d268-1b9a-4fb0-8290-11bc6c5edf99 req-6831e68a-41d6-49e6-8bbb-ffd1e7d219d1 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-2357d268-1b9a-4fb0-8290-11bc6c5edf99 req-6831e68a-41d6-49e6-8bbb-ffd1e7d219d1 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:14 user nova-compute[72818]: WARNING nova.compute.manager [req-2357d268-1b9a-4fb0-8290-11bc6c5edf99 req-6831e68a-41d6-49e6-8bbb-ffd1e7d219d1 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state active and task_state rescuing.
Aug 17 21:24:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-2357d268-1b9a-4fb0-8290-11bc6c5edf99 req-6831e68a-41d6-49e6-8bbb-ffd1e7d219d1 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2357d268-1b9a-4fb0-8290-11bc6c5edf99 req-6831e68a-41d6-49e6-8bbb-ffd1e7d219d1 service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2357d268-1b9a-4fb0-8290-11bc6c5edf99 req-6831e68a-41d6-49e6-8bbb-ffd1e7d219d1 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2357d268-1b9a-4fb0-8290-11bc6c5edf99 req-6831e68a-41d6-49e6-8bbb-ffd1e7d219d1 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-2357d268-1b9a-4fb0-8290-11bc6c5edf99 req-6831e68a-41d6-49e6-8bbb-ffd1e7d219d1 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:14 user nova-compute[72818]: WARNING nova.compute.manager [req-2357d268-1b9a-4fb0-8290-11bc6c5edf99 req-6831e68a-41d6-49e6-8bbb-ffd1e7d219d1 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state active and task_state rescuing.
Aug 17 21:24:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:14 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance destroyed successfully.
Aug 17 21:24:14 user nova-compute[72818]: DEBUG nova.objects.instance [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'resources' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949986485',display_name='tempest-ServerActionsTestOtherB-server-949986485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949986485',id=13,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRc64wH9u6dm3xi4kk/wBQ/vGvOzR5k+mWwsr3HttVU/OU3wMLvrRNNKLA460//NVqERVsDyz6LYVlThM/1o9Ih8+/vljt/Rg70GDESbu8oCMaWXuSfr3pfnG0YVMizwg==',key_name='tempest-keypair-722674119',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:22:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a18e542cdfb74711b0decf0c1f008e0b',ramdisk_id='',reservation_id='r-jwckp96f',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1842371167',owner_user_name='tempest-ServerActionsTestOtherB-1842371167-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:22:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e0d4b90694b09a71fc7790bb532df',uuid=e8b5ccab-5dff-4458-a799-8c8528a032b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converting VIF {"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG os_vif [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25efe920-cf, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:14 user nova-compute[72818]: INFO os_vif [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf')
Aug 17 21:24:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTbWkAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:24:14 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:24:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[58afc730-be94-4551-a3df-27cb49d4f088]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76f80f4-4553-4b35-a52a-19607c866042]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:24:14 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:24:14 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:24:14 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:24:14 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:24:14 user nova-compute[72818]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:24:14 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:24:14 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:24:14 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f2860c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4545e7-e930-4a29-bae6-244d1e9a586b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae55cc21-1325-4c73-ba0d-841ce7f2f25a]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[860506ed-cf10-475f-b68b-5774fd7e37eb]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:24:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c37f032-7325-42c5-abdb-a925c6b1e4ac]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84908d2-e087-49c5-a4ef-6e505f97dfc0]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf4595a-c7c5-46b6-8f63-82387863d160]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260]
Aug 17 21:24:15 user nova-compute[72818]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260] successful.
Aug 17 21:24:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e8f051-6562-42d8-a19a-d402e7356b54]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] <== disconnect_volume: return (312ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for 4b43de5d-62c1-4368-8a77-59899ae0b16d due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307455.2333603, 4b43de5d-62c1-4368-8a77-59899ae0b16d => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:24:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] VM Resumed (Lifecycle Event)
Aug 17 21:24:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-6efc26a9-d156-4d72-8c2a-ee6395a26f90 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:24:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 21:24:15 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307455.2350588, 4b43de5d-62c1-4368-8a77-59899ae0b16d => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:24:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] VM Started (Lifecycle Event)
Aug 17 21:24:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:24:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:24:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:16 user nova-compute[72818]: DEBUG nova.objects.instance [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'migration_context' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-1d2b69ba-6af7-43b9-b558-9cb9caf35988 req-1ff675ad-0dd4-4ae4-91b6-ef075827a827 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1d2b69ba-6af7-43b9-b558-9cb9caf35988 req-1ff675ad-0dd4-4ae4-91b6-ef075827a827 service nova] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1d2b69ba-6af7-43b9-b558-9cb9caf35988 req-1ff675ad-0dd4-4ae4-91b6-ef075827a827 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1d2b69ba-6af7-43b9-b558-9cb9caf35988 req-1ff675ad-0dd4-4ae4-91b6-ef075827a827 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-1d2b69ba-6af7-43b9-b558-9cb9caf35988 req-1ff675ad-0dd4-4ae4-91b6-ef075827a827 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] No waiting events found dispatching network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:16 user nova-compute[72818]: WARNING nova.compute.manager [req-1d2b69ba-6af7-43b9-b558-9cb9caf35988 req-1ff675ad-0dd4-4ae4-91b6-ef075827a827 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received unexpected event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 for instance with vm_state resized and task_state resize_reverting.
Aug 17 21:24:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:16 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:24:16 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:24:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.611s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:16 user nova-compute[72818]: INFO nova.compute.manager [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Swapping old allocation on dict_keys(['d156e3af-684d-47e1-a951-585f9c95fa46']) held by migration 7b55f893-ec80-4bfa-beeb-8857fda52608 for instance
Aug 17 21:24:16 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Overwriting current allocation {'allocations': {'d156e3af-684d-47e1-a951-585f9c95fa46': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 29}}, 'project_id': 'a18e542cdfb74711b0decf0c1f008e0b', 'user_id': 'c20e0d4b90694b09a71fc7790bb532df', 'consumer_generation': 1} on consumer e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquired lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating instance_info_cache with network_info: [{"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Releasing lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG os_brick.utils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e52d12-d0fb-4602-8c5b-9fdb66c47f76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe39bb2-0497-426f-89ba-a1f7627023b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a73dfe-86d4-4652-a8db-44ed637a6af5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[479157f1-5e85-4a58-b5d1-ad04a10ac85a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:24:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:24:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:24:18 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:24:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6be51e4-5583-4f22-b5d9-4b4ad5b14abb]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:24:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:24:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:24:18 user nova-compute[72818]: DEBUG os_brick.utils [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:24:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-1a3bcf72-52dd-4c18-bd61-7b47113a06c7 req-b79b5358-98d4-4ea6-9002-f624991af2f2 service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Received event network-changed-b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-1a3bcf72-52dd-4c18-bd61-7b47113a06c7 req-b79b5358-98d4-4ea6-9002-f624991af2f2 service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Refreshing instance network info cache due to event network-changed-b1c58ade-9008-4db9-9c4f-29a6b2765a1a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:24:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1a3bcf72-52dd-4c18-bd61-7b47113a06c7 req-b79b5358-98d4-4ea6-9002-f624991af2f2 service nova] Acquiring lock "refresh_cache-587af1f4-36d1-4bbd-a091-b42857ee8637" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:24:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1a3bcf72-52dd-4c18-bd61-7b47113a06c7 req-b79b5358-98d4-4ea6-9002-f624991af2f2 service nova] Acquired lock "refresh_cache-587af1f4-36d1-4bbd-a091-b42857ee8637" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:24:20 user nova-compute[72818]: DEBUG nova.network.neutron [req-1a3bcf72-52dd-4c18-bd61-7b47113a06c7 req-b79b5358-98d4-4ea6-9002-f624991af2f2 service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Refreshing network info cache for port b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "587af1f4-36d1-4bbd-a091-b42857ee8637" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG nova.objects.instance [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lazy-loading 'flavor' on Instance uuid 587af1f4-36d1-4bbd-a091-b42857ee8637 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:21 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Ignoring supplied device name: /dev/vdb
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "587af1f4-36d1-4bbd-a091-b42857ee8637" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:21 user nova-compute[72818]: INFO nova.compute.manager [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Attaching volume 214645ee-a888-4f40-a600-bba27b987fea to /dev/vdb
Aug 17 21:24:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG os_brick.utils [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e79a0ef-d6d4-42dc-9882-4897f4f6b376]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[12364092-6454-4628-9ba1-d75d304f36bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[52202b00-5ac2-4ec1-9496-2f3c2e36f08d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c38104-397f-48dc-ab09-c364093a9ff8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:24:21 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:24:21 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab06f7d-b74e-45e0-85de-79a28c8b67dd]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG os_brick.utils [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:24:21 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Updating existing volume attachment record: 0c91f7ff-79be-4014-bb06-24b7b1111a1a {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:24:22 user nova-compute[72818]: DEBUG nova.network.neutron [req-1a3bcf72-52dd-4c18-bd61-7b47113a06c7 req-b79b5358-98d4-4ea6-9002-f624991af2f2 service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Updated VIF entry in instance network info cache for port b1c58ade-9008-4db9-9c4f-29a6b2765a1a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:24:22 user nova-compute[72818]: DEBUG nova.network.neutron [req-1a3bcf72-52dd-4c18-bd61-7b47113a06c7 req-b79b5358-98d4-4ea6-9002-f624991af2f2 service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Updating instance_info_cache with network_info: [{"id": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "address": "fa:16:3e:b1:57:ff", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c58ade-90", "ovs_interfaceid": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:24:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1a3bcf72-52dd-4c18-bd61-7b47113a06c7 req-b79b5358-98d4-4ea6-9002-f624991af2f2 service nova] Releasing lock "refresh_cache-587af1f4-36d1-4bbd-a091-b42857ee8637" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:24:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:29 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307454.8014886, e8b5ccab-5dff-4458-a799-8c8528a032b1 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:24:29 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] VM Stopped (Lifecycle Event)
Aug 17 21:24:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f21e2dc8-9593-4db5-a8d2-f442a1df919e None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:24:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Starting finish_revert_migration {{(pid=72818) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Start _get_guest_xml network_info=[{"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '1337c9f4-f4d4-4269-bcdb-0cc0c464f638', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTbWkAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e8b5ccab-5dff-4458-a799-8c8528a032b1', 'attached_at': '2023-08-17T21:24:31.000000', 'detached_at': '', 'volume_id': '943bedfa-18f9-40fc-a827-0e911837568b', 'serial': '943bedfa-18f9-40fc-a827-0e911837568b'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:24:30 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:24:30 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.objects.instance [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'vcpu_model' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTbWkAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:24:30 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:24:30 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:24:30 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc715cd-d3a9-48d4-83ab-a7743a8ee5b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:24:30 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4cbea9-83de-4e81-a6f7-2dcc889b88b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b] added
Aug 17 21:24:30 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f6bfa4-59a0-4baf-a7c9-7d2478b28394]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86368cd-dade-4b69-8a0c-7d92a88b574d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gfTbWkAM {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gfTbWkAM" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c42b9a-2ed8-404f-939d-17c358228e0a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gfTbWkAM'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daa6145-5dbf-44f9-92d2-2598e95d0c07]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6ed135-f998-47ee-93d0-08fa570d0017]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:24:30 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:24:30 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:24:30 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:24:30 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:24:30 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:24:30 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:24:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b793e47a-49df-4263-8d22-a7106e6fdee1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260]
Aug 17 21:24:31 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260] successful.
Aug 17 21:24:31 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3261a50e-9f45-4556-9198-1f345036f186]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e31a4cf-2f8e-4bcb-98a0-1557f50a904e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:24:31 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:24:31 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:24:31 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:24:31 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:24:31 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:24:31 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:24:31 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:24:31 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6214bcef-b70c-47be-b64d-507f7c5ec4f1]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:24:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTbWkAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23063336463326336', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063336463326336', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949986485',display_name='tempest-ServerActionsTestOtherB-server-949986485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949986485',id=13,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRc64wH9u6dm3xi4kk/wBQ/vGvOzR5k+mWwsr3HttVU/OU3wMLvrRNNKLA460//NVqERVsDyz6LYVlThM/1o9Ih8+/vljt/Rg70GDESbu8oCMaWXuSfr3pfnG0YVMizwg==',key_name='tempest-keypair-722674119',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:22:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a18e542cdfb74711b0decf0c1f008e0b',ramdisk_id='',reservation_id='r-jwckp96f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1842371167',owner_user_name='tempest-ServerActionsTestOtherB-1842371167-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e0d4b90694b09a71fc7790bb532df',uuid=e8b5ccab-5dff-4458-a799-8c8528a032b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converting VIF {"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:24:32 user nova-compute[72818]:   <uuid>e8b5ccab-5dff-4458-a799-8c8528a032b1</uuid>
Aug 17 21:24:32 user nova-compute[72818]:   <name>instance-0000000d</name>
Aug 17 21:24:32 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:24:32 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:24:32 user nova-compute[72818]:   <metadata>
Aug 17 21:24:32 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:24:32 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:24:32 user nova-compute[72818]:       <nova:name>tempest-ServerActionsTestOtherB-server-949986485</nova:name>
Aug 17 21:24:32 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:24:30</nova:creationTime>
Aug 17 21:24:32 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:24:32 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:24:32 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:24:32 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:24:32 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:24:32 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:24:32 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:24:32 user nova-compute[72818]:       <nova:owner>
Aug 17 21:24:32 user nova-compute[72818]:         <nova:user uuid="c20e0d4b90694b09a71fc7790bb532df">tempest-ServerActionsTestOtherB-1842371167-project-member</nova:user>
Aug 17 21:24:32 user nova-compute[72818]:         <nova:project uuid="a18e542cdfb74711b0decf0c1f008e0b">tempest-ServerActionsTestOtherB-1842371167</nova:project>
Aug 17 21:24:32 user nova-compute[72818]:       </nova:owner>
Aug 17 21:24:32 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:24:32 user nova-compute[72818]:       <nova:ports>
Aug 17 21:24:32 user nova-compute[72818]:         <nova:port uuid="25efe920-cfdf-428d-86ee-0f9b8f301e11">
Aug 17 21:24:32 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 21:24:32 user nova-compute[72818]:         </nova:port>
Aug 17 21:24:32 user nova-compute[72818]:       </nova:ports>
Aug 17 21:24:32 user nova-compute[72818]:     </nova:instance>
Aug 17 21:24:32 user nova-compute[72818]:   </metadata>
Aug 17 21:24:32 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:24:32 user nova-compute[72818]:     <system>
Aug 17 21:24:32 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:24:32 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:24:32 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:24:32 user nova-compute[72818]:       <entry name="serial">e8b5ccab-5dff-4458-a799-8c8528a032b1</entry>
Aug 17 21:24:32 user nova-compute[72818]:       <entry name="uuid">e8b5ccab-5dff-4458-a799-8c8528a032b1</entry>
Aug 17 21:24:32 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:24:32 user nova-compute[72818]:     </system>
Aug 17 21:24:32 user nova-compute[72818]:   </sysinfo>
Aug 17 21:24:32 user nova-compute[72818]:   <os>
Aug 17 21:24:32 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:24:32 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:24:32 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:24:32 user nova-compute[72818]:   </os>
Aug 17 21:24:32 user nova-compute[72818]:   <features>
Aug 17 21:24:32 user nova-compute[72818]:     <acpi/>
Aug 17 21:24:32 user nova-compute[72818]:     <apic/>
Aug 17 21:24:32 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:24:32 user nova-compute[72818]:   </features>
Aug 17 21:24:32 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:24:32 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:24:32 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:24:32 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:24:32 user nova-compute[72818]:   </clock>
Aug 17 21:24:32 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:24:32 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:24:32 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:24:32 user nova-compute[72818]:   </cpu>
Aug 17 21:24:32 user nova-compute[72818]:   <devices>
Aug 17 21:24:32 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:24:32 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:24:32 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk"/>
Aug 17 21:24:32 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:24:32 user nova-compute[72818]:     </disk>
Aug 17 21:24:32 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:24:32 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:24:32 user nova-compute[72818]:       <source dev="/dev/sdb"/>
Aug 17 21:24:32 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:24:32 user nova-compute[72818]:       <serial>943bedfa-18f9-40fc-a827-0e911837568b</serial>
Aug 17 21:24:32 user nova-compute[72818]:     </disk>
Aug 17 21:24:32 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:24:32 user nova-compute[72818]:       <mac address="fa:16:3e:ba:1c:1e"/>
Aug 17 21:24:32 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:24:32 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:24:32 user nova-compute[72818]:       <target dev="tap25efe920-cf"/>
Aug 17 21:24:32 user nova-compute[72818]:     </interface>
Aug 17 21:24:32 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:24:32 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/console.log" append="off"/>
Aug 17 21:24:32 user nova-compute[72818]:     </serial>
Aug 17 21:24:32 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:24:32 user nova-compute[72818]:     <video>
Aug 17 21:24:32 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:24:32 user nova-compute[72818]:     </video>
Aug 17 21:24:32 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:24:32 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:24:32 user nova-compute[72818]:     </rng>
Aug 17 21:24:32 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:24:32 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:24:32 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:24:32 user nova-compute[72818]:     </memballoon>
Aug 17 21:24:32 user nova-compute[72818]:   </devices>
Aug 17 21:24:32 user nova-compute[72818]: </domain>
Aug 17 21:24:32 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949986485',display_name='tempest-ServerActionsTestOtherB-server-949986485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949986485',id=13,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRc64wH9u6dm3xi4kk/wBQ/vGvOzR5k+mWwsr3HttVU/OU3wMLvrRNNKLA460//NVqERVsDyz6LYVlThM/1o9Ih8+/vljt/Rg70GDESbu8oCMaWXuSfr3pfnG0YVMizwg==',key_name='tempest-keypair-722674119',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:22:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a18e542cdfb74711b0decf0c1f008e0b',ramdisk_id='',reservation_id='r-jwckp96f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1842371167',owner_user_name='tempest-ServerActionsTestOtherB-1842371167-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e0d4b90694b09a71fc7790bb532df',uuid=e8b5ccab-5dff-4458-a799-8c8528a032b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converting VIF {"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG os_vif [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25efe920-cf, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25efe920-cf, col_values=(('external_ids', {'iface-id': '25efe920-cfdf-428d-86ee-0f9b8f301e11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:1c:1e', 'vm-uuid': 'e8b5ccab-5dff-4458-a799-8c8528a032b1'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:24:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:32 user nova-compute[72818]: INFO os_vif [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf')
Aug 17 21:24:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-1c994d83-6782-4853-988f-f4691d42cd89 req-f9fc947f-3f87-4426-b72b-9d297c765d88 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1c994d83-6782-4853-988f-f4691d42cd89 req-f9fc947f-3f87-4426-b72b-9d297c765d88 service nova] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1c994d83-6782-4853-988f-f4691d42cd89 req-f9fc947f-3f87-4426-b72b-9d297c765d88 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1c994d83-6782-4853-988f-f4691d42cd89 req-f9fc947f-3f87-4426-b72b-9d297c765d88 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-1c994d83-6782-4853-988f-f4691d42cd89 req-f9fc947f-3f87-4426-b72b-9d297c765d88 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] No waiting events found dispatching network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:33 user nova-compute[72818]: WARNING nova.compute.manager [req-1c994d83-6782-4853-988f-f4691d42cd89 req-f9fc947f-3f87-4426-b72b-9d297c765d88 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received unexpected event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 for instance with vm_state resized and task_state resize_reverting.
Aug 17 21:24:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MPsmxOrI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:24:34 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:24:34 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:24:34 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff82b18-c04b-498c-8b03-537c58745c93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:24:34 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0f1da0-0265-482e-b093-bf05d965f3ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea] added
Aug 17 21:24:34 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[01387695-0547-420d-92fb-cebf17480ec1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ebdc7b-7bbf-417f-aa7f-ae290ad088d2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MPsmxOrI {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MPsmxOrI" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92c25e9-c19e-40c5-8e22-b14116f449ae]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MPsmxOrI'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[297576be-acc5-4497-b415-569bed9ba1e2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4191cbb2-8ad1-4ab5-aa44-78763fc6f6cf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:24:34 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:24:34 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6968543f-864e-40d6-9b12-7548f5ccad3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea, portal: 172.16.0.220,3260]
Aug 17 21:24:34 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea, portal: 172.16.0.220,3260] successful.
Aug 17 21:24:34 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a82ae1b-e98b-4d70-a293-791151b044f1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ff6ea3-914e-459f-84f6-96681312769c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)
Aug 17 21:24:34 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:24:34 user nova-compute[72818]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)
Aug 17 21:24:34 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13d5506-c08b-430a-bddc-3cc05792ce89]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:24:34 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:24:35 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:24:35 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MPsmxOrI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:24:35 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:24:35 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23434386263343532', 'path': '/dev/sde'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:24:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434386263343532', 'path': '/dev/sde'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:24:35 user nova-compute[72818]: DEBUG nova.objects.instance [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lazy-loading 'flavor' on Instance uuid 587af1f4-36d1-4bbd-a091-b42857ee8637 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:24:35 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:24:35 user nova-compute[72818]:   <source dev="/dev/sde"/>
Aug 17 21:24:35 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:24:35 user nova-compute[72818]:   <serial>214645ee-a888-4f40-a600-bba27b987fea</serial>
Aug 17 21:24:35 user nova-compute[72818]: </disk>
Aug 17 21:24:35 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:24:35 user nova-compute[72818]: DEBUG nova.compute.manager [req-bab5cae8-3d0a-4cce-a059-8a27ad3429fc req-8ee7e93f-666e-46fd-86ce-763a849acff3 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bab5cae8-3d0a-4cce-a059-8a27ad3429fc req-8ee7e93f-666e-46fd-86ce-763a849acff3 service nova] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bab5cae8-3d0a-4cce-a059-8a27ad3429fc req-8ee7e93f-666e-46fd-86ce-763a849acff3 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bab5cae8-3d0a-4cce-a059-8a27ad3429fc req-8ee7e93f-666e-46fd-86ce-763a849acff3 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:35 user nova-compute[72818]: DEBUG nova.compute.manager [req-bab5cae8-3d0a-4cce-a059-8a27ad3429fc req-8ee7e93f-666e-46fd-86ce-763a849acff3 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] No waiting events found dispatching network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:35 user nova-compute[72818]: WARNING nova.compute.manager [req-bab5cae8-3d0a-4cce-a059-8a27ad3429fc req-8ee7e93f-666e-46fd-86ce-763a849acff3 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received unexpected event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 for instance with vm_state resized and task_state resize_reverting.
Aug 17 21:24:36 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307476.0627284, e8b5ccab-5dff-4458-a799-8c8528a032b1 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:24:36 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] VM Resumed (Lifecycle Event)
Aug 17 21:24:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:24:36 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance running successfully.
Aug 17 21:24:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] finish_revert_migration finished successfully. {{(pid=72818) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 17 21:24:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:24:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:24:36 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 21:24:36 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307476.0666928, e8b5ccab-5dff-4458-a799-8c8528a032b1 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:24:36 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] VM Started (Lifecycle Event)
Aug 17 21:24:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:24:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:24:36 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 21:24:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:24:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:24:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] No VIF found with MAC fa:16:3e:b1:57:ff, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:24:36 user nova-compute[72818]: INFO nova.compute.manager [None req-776dbd95-0552-4c31-8b35-7c01474833c5 tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating instance to original state: 'active'
Aug 17 21:24:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-75615765-b6f5-4819-bc5e-8bc4ad2f441b tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.907s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "2be86065-3020-4d42-b1d2-000a50d96a82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "2be86065-3020-4d42-b1d2-000a50d96a82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:40 user nova-compute[72818]: INFO nova.compute.manager [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Terminating instance
Aug 17 21:24:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-60d75161-08b1-4c35-9561-bc828a0da787 req-3df206df-8e3e-4550-9845-27912bc888a1 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Received event network-vif-unplugged-e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-60d75161-08b1-4c35-9561-bc828a0da787 req-3df206df-8e3e-4550-9845-27912bc888a1 service nova] Acquiring lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-60d75161-08b1-4c35-9561-bc828a0da787 req-3df206df-8e3e-4550-9845-27912bc888a1 service nova] Lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-60d75161-08b1-4c35-9561-bc828a0da787 req-3df206df-8e3e-4550-9845-27912bc888a1 service nova] Lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-60d75161-08b1-4c35-9561-bc828a0da787 req-3df206df-8e3e-4550-9845-27912bc888a1 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] No waiting events found dispatching network-vif-unplugged-e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-60d75161-08b1-4c35-9561-bc828a0da787 req-3df206df-8e3e-4550-9845-27912bc888a1 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Received event network-vif-unplugged-e09916d1-412a-4ee2-ba27-5b87c12cef2f for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:40 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Instance destroyed successfully.
Aug 17 21:24:40 user nova-compute[72818]: DEBUG nova.objects.instance [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lazy-loading 'resources' on Instance uuid 2be86065-3020-4d42-b1d2-000a50d96a82 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-913261563',display_name='tempest-ServersNegativeTestJSON-server-913261563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-913261563',id=21,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='885c25f7a170493480c909f74b2188d1',ramdisk_id='',reservation_id='r-yzq1giho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1481471081',owner_user_name='tempest-ServersNegativeTestJSON-1481471081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:22:57Z,user_data=None,user_id='721ba7982e32474aa2516493125fbf18',uuid=2be86065-3020-4d42-b1d2-000a50d96a82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "address": "fa:16:3e:c9:de:36", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09916d1-41", "ovs_interfaceid": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Converting VIF {"id": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "address": "fa:16:3e:c9:de:36", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09916d1-41", "ovs_interfaceid": "e09916d1-412a-4ee2-ba27-5b87c12cef2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:de:36,bridge_name='br-int',has_traffic_filtering=True,id=e09916d1-412a-4ee2-ba27-5b87c12cef2f,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09916d1-41') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG os_vif [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:de:36,bridge_name='br-int',has_traffic_filtering=True,id=e09916d1-412a-4ee2-ba27-5b87c12cef2f,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09916d1-41') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape09916d1-41, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:24:40 user nova-compute[72818]: INFO os_vif [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:de:36,bridge_name='br-int',has_traffic_filtering=True,id=e09916d1-412a-4ee2-ba27-5b87c12cef2f,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09916d1-41')
Aug 17 21:24:40 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Deleting instance files /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82_del
Aug 17 21:24:40 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Deletion of /opt/stack/data/nova/instances/2be86065-3020-4d42-b1d2-000a50d96a82_del complete
Aug 17 21:24:40 user nova-compute[72818]: INFO nova.compute.manager [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Took 0.78 seconds to destroy the instance on the hypervisor.
Aug 17 21:24:40 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:24:40 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:24:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:41 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:24:41 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Took 0.84 seconds to deallocate network for instance.
Aug 17 21:24:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-027deb62-0d23-4b05-a216-f7f2d1a5d9a0 req-fa1d42fd-4beb-42b9-8de5-fab33a83c75c service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Received event network-vif-deleted-e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:42 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:24:42 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:24:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:42 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Deleted allocations for instance 2be86065-3020-4d42-b1d2-000a50d96a82
Aug 17 21:24:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-01c0ad76-df99-47e1-a2e3-97ba1695c52e tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "2be86065-3020-4d42-b1d2-000a50d96a82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.280s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-b0e02c36-56c8-4947-9ae8-0b0025be66aa req-931d6780-694b-4527-825a-18ee490eb4f9 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Received event network-vif-plugged-e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b0e02c36-56c8-4947-9ae8-0b0025be66aa req-931d6780-694b-4527-825a-18ee490eb4f9 service nova] Acquiring lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b0e02c36-56c8-4947-9ae8-0b0025be66aa req-931d6780-694b-4527-825a-18ee490eb4f9 service nova] Lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b0e02c36-56c8-4947-9ae8-0b0025be66aa req-931d6780-694b-4527-825a-18ee490eb4f9 service nova] Lock "2be86065-3020-4d42-b1d2-000a50d96a82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-b0e02c36-56c8-4947-9ae8-0b0025be66aa req-931d6780-694b-4527-825a-18ee490eb4f9 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] No waiting events found dispatching network-vif-plugged-e09916d1-412a-4ee2-ba27-5b87c12cef2f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:42 user nova-compute[72818]: WARNING nova.compute.manager [req-b0e02c36-56c8-4947-9ae8-0b0025be66aa req-931d6780-694b-4527-825a-18ee490eb4f9 service nova] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Received unexpected event network-vif-plugged-e09916d1-412a-4ee2-ba27-5b87c12cef2f for instance with vm_state deleted and task_state None.
Aug 17 21:24:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:55 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307480.7138205, 2be86065-3020-4d42-b1d2-000a50d96a82 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:24:55 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] VM Stopped (Lifecycle Event)
Aug 17 21:24:55 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c1935101-5016-4769-a466-bf558d81b3fa None None] [instance: 2be86065-3020-4d42-b1d2-000a50d96a82] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:24:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-e758d780-b1f7-4426-a488-d0bcf6ebda7a req-fa665a0d-002a-464c-bd32-4f993b81a2ed service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-changed-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-e758d780-b1f7-4426-a488-d0bcf6ebda7a req-fa665a0d-002a-464c-bd32-4f993b81a2ed service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Refreshing instance network info cache due to event network-changed-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:24:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e758d780-b1f7-4426-a488-d0bcf6ebda7a req-fa665a0d-002a-464c-bd32-4f993b81a2ed service nova] Acquiring lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:24:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e758d780-b1f7-4426-a488-d0bcf6ebda7a req-fa665a0d-002a-464c-bd32-4f993b81a2ed service nova] Acquired lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:24:58 user nova-compute[72818]: DEBUG nova.network.neutron [req-e758d780-b1f7-4426-a488-d0bcf6ebda7a req-fa665a0d-002a-464c-bd32-4f993b81a2ed service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Refreshing network info cache for port 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:24:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:58 user nova-compute[72818]: INFO nova.compute.manager [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Shelve offloading
Aug 17 21:24:59 user nova-compute[72818]: DEBUG nova.network.neutron [req-e758d780-b1f7-4426-a488-d0bcf6ebda7a req-fa665a0d-002a-464c-bd32-4f993b81a2ed service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updated VIF entry in instance network info cache for port 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG nova.network.neutron [req-e758d780-b1f7-4426-a488-d0bcf6ebda7a req-fa665a0d-002a-464c-bd32-4f993b81a2ed service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updating instance_info_cache with network_info: [{"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e758d780-b1f7-4426-a488-d0bcf6ebda7a req-fa665a0d-002a-464c-bd32-4f993b81a2ed service nova] Releasing lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-2270e4c9-50c3-473d-9acc-f35f84ad8ade req-d4afdc7a-5667-49e9-998c-360ee6a7e97d service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-vif-unplugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2270e4c9-50c3-473d-9acc-f35f84ad8ade req-d4afdc7a-5667-49e9-998c-360ee6a7e97d service nova] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2270e4c9-50c3-473d-9acc-f35f84ad8ade req-d4afdc7a-5667-49e9-998c-360ee6a7e97d service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2270e4c9-50c3-473d-9acc-f35f84ad8ade req-d4afdc7a-5667-49e9-998c-360ee6a7e97d service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-2270e4c9-50c3-473d-9acc-f35f84ad8ade req-d4afdc7a-5667-49e9-998c-360ee6a7e97d service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] No waiting events found dispatching network-vif-unplugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:24:59 user nova-compute[72818]: WARNING nova.compute.manager [req-2270e4c9-50c3-473d-9acc-f35f84ad8ade req-d4afdc7a-5667-49e9-998c-360ee6a7e97d service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received unexpected event network-vif-unplugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a for instance with vm_state active and task_state shelving.
Aug 17 21:24:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:24:59 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Instance destroyed successfully.
Aug 17 21:24:59 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquired lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:24:59 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating instance_info_cache with network_info: [{"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-e8b5ccab-5dff-4458-a799-8c8528a032b1" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:00 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updating instance_info_cache with network_info: [{"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Releasing lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-d0f373aa-7dfe-43b2-b582-fce900ae8abd req-a4d96bb7-578c-48ad-b1ca-3ed72d43205d service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d0f373aa-7dfe-43b2-b582-fce900ae8abd req-a4d96bb7-578c-48ad-b1ca-3ed72d43205d service nova] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d0f373aa-7dfe-43b2-b582-fce900ae8abd req-a4d96bb7-578c-48ad-b1ca-3ed72d43205d service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d0f373aa-7dfe-43b2-b582-fce900ae8abd req-a4d96bb7-578c-48ad-b1ca-3ed72d43205d service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-d0f373aa-7dfe-43b2-b582-fce900ae8abd req-a4d96bb7-578c-48ad-b1ca-3ed72d43205d service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] No waiting events found dispatching network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:25:01 user nova-compute[72818]: WARNING nova.compute.manager [req-d0f373aa-7dfe-43b2-b582-fce900ae8abd req-a4d96bb7-578c-48ad-b1ca-3ed72d43205d service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received unexpected event network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a for instance with vm_state active and task_state shelving.
Aug 17 21:25:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-a14ac93a-f02c-4e70-b091-69ead91259e9 req-3c094b35-ec78-49b7-842f-68945b18b3ff service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event network-changed-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-a14ac93a-f02c-4e70-b091-69ead91259e9 req-3c094b35-ec78-49b7-842f-68945b18b3ff service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Refreshing instance network info cache due to event network-changed-c0ef7f30-6392-41c4-9d25-03f33cf3766a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a14ac93a-f02c-4e70-b091-69ead91259e9 req-3c094b35-ec78-49b7-842f-68945b18b3ff service nova] Acquiring lock "refresh_cache-9f46c1c0-c2b8-40cf-991f-c99735954429" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a14ac93a-f02c-4e70-b091-69ead91259e9 req-3c094b35-ec78-49b7-842f-68945b18b3ff service nova] Acquired lock "refresh_cache-9f46c1c0-c2b8-40cf-991f-c99735954429" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG nova.network.neutron [req-a14ac93a-f02c-4e70-b091-69ead91259e9 req-3c094b35-ec78-49b7-842f-68945b18b3ff service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Refreshing network info cache for port c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Instance destroyed successfully.
Aug 17 21:25:02 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lazy-loading 'resources' on Instance uuid 92f865e1-d261-47e3-a64d-dc7bc6e7a93f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-722415076',display_name='tempest-TestShelveInstance-server-722415076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-722415076',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbPQv3z46gQnD4kxEjmUMxOixZmn4RDSrvj8X5ykYzwAOh9lGPQIyUa74vFa9YDsWg3lQ+Ldy4b84xgODAEdHo+3ZxHtuJ0Eqiefl9WxOeAXl0smQQSiJMBvhsgbOQE/Q==',key_name='tempest-TestShelveInstance-1267606421',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:23:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30ddbaf2a03d4f14b7b7ca0096d05c4a',ramdisk_id='',reservation_id='r-k1p3u19l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-15245591',owner_user_name='tempest-TestShelveInstance-15245591-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:23:25Z,user_data=None,user_id='859bd4e053cd4fc6b7e6633afb107758',uuid=92f865e1-d261-47e3-a64d-dc7bc6e7a93f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Converting VIF {"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_vif [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG nova.network.neutron [req-a14ac93a-f02c-4e70-b091-69ead91259e9 req-3c094b35-ec78-49b7-842f-68945b18b3ff service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Updated VIF entry in instance network info cache for port c0ef7f30-6392-41c4-9d25-03f33cf3766a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG nova.network.neutron [req-a14ac93a-f02c-4e70-b091-69ead91259e9 req-3c094b35-ec78-49b7-842f-68945b18b3ff service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Updating instance_info_cache with network_info: [{"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11b6e8dd-b7, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:25:02 user nova-compute[72818]: INFO os_vif [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7')
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a14ac93a-f02c-4e70-b091-69ead91259e9 req-3c094b35-ec78-49b7-842f-68945b18b3ff service nova] Releasing lock "refresh_cache-9f46c1c0-c2b8-40cf-991f-c99735954429" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZVeHRuyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:25:02 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0958d311-4878-4778-870d-200d375af546]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd8511a-9adf-4777-a390-16c5da3c8861]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:02 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:25:02 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:25:02 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:02 user nova-compute[72818]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)
Aug 17 21:25:02 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:02 user nova-compute[72818]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:25:02 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:25:02 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:02 user nova-compute[72818]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)
Aug 17 21:25:02 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f2853b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f'): ({'sdc'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Removing single pathed devices sdc {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bb1f54-212a-4fa4-89c6-a926f1627d10]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[536d7d07-ea52-4360-924f-8ff42d7d49f3]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Flushing IO for device /dev/sdc {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[397f081e-7cb4-4252-bd17-7a688ba61bce]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b449648-1ebb-452f-badc-ccb705e4e9c2]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c4cd76-e2e5-4308-a03a-464741f90c55]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f26292a-208e-4b69-8317-32f005c04ff3]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260]
Aug 17 21:25:02 user nova-compute[72818]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260] successful.
Aug 17 21:25:02 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5429a92f-8f5e-420a-9278-ecaf1e88cf32]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] <== disconnect_volume: return (421ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:25:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Deleting instance files /opt/stack/data/nova/instances/92f865e1-d261-47e3-a64d-dc7bc6e7a93f_del
Aug 17 21:25:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Deletion of /opt/stack/data/nova/instances/92f865e1-d261-47e3-a64d-dc7bc6e7a93f_del complete
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: INFO nova.compute.manager [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Rebuilding instance
Aug 17 21:25:02 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9f46c1c0-c2b8-40cf-991f-c99735954429 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lazy-loading 'pci_requests' on Instance uuid 9f46c1c0-c2b8-40cf-991f-c99735954429 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f46c1c0-c2b8-40cf-991f-c99735954429 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lazy-loading 'resources' on Instance uuid 9f46c1c0-c2b8-40cf-991f-c99735954429 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lazy-loading 'migration_context' on Instance uuid 9f46c1c0-c2b8-40cf-991f-c99735954429 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72818) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-dd9814fa-e0bd-4a66-859e-c61db120067e req-d6427259-e6a6-4c8e-a802-ffa2643c2fe6 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event network-vif-unplugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-dd9814fa-e0bd-4a66-859e-c61db120067e req-d6427259-e6a6-4c8e-a802-ffa2643c2fe6 service nova] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-dd9814fa-e0bd-4a66-859e-c61db120067e req-d6427259-e6a6-4c8e-a802-ffa2643c2fe6 service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-dd9814fa-e0bd-4a66-859e-c61db120067e req-d6427259-e6a6-4c8e-a802-ffa2643c2fe6 service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-dd9814fa-e0bd-4a66-859e-c61db120067e req-d6427259-e6a6-4c8e-a802-ffa2643c2fe6 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] No waiting events found dispatching network-vif-unplugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:25:03 user nova-compute[72818]: WARNING nova.compute.manager [req-dd9814fa-e0bd-4a66-859e-c61db120067e req-d6427259-e6a6-4c8e-a802-ffa2643c2fe6 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received unexpected event network-vif-unplugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a for instance with vm_state active and task_state rebuilding.
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-9add354f-2012-428b-a162-c81da60fef69 req-f5cb1fea-81dd-4b93-aa14-159b1167d70b service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-changed-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-9add354f-2012-428b-a162-c81da60fef69 req-f5cb1fea-81dd-4b93-aa14-159b1167d70b service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Refreshing instance network info cache due to event network-changed-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9add354f-2012-428b-a162-c81da60fef69 req-f5cb1fea-81dd-4b93-aa14-159b1167d70b service nova] Acquiring lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9add354f-2012-428b-a162-c81da60fef69 req-f5cb1fea-81dd-4b93-aa14-159b1167d70b service nova] Acquired lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.network.neutron [req-9add354f-2012-428b-a162-c81da60fef69 req-f5cb1fea-81dd-4b93-aa14-159b1167d70b service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Refreshing network info cache for port 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Instance destroyed successfully.
Aug 17 21:25:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Instance destroyed successfully.
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-770936818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2060472075',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK9sJ2eq4o1JXfewQMshfkbC/kWFIvZxaJPcJLK3eMuQLLKsKNEtt9xLpxeN3txHMhagw7dYKiIeNu3aT7ClMUBqylRglK6VlcEfzYrHDU428DAM8IN/BPX4mbewJMS+Q==',key_name='tempest-keypair-741246036',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ba1c61f7c2e4fd5a5a15bf69db27050',ramdisk_id='',reservation_id='r-rmts4810',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-329717180',owner_user_name='tempest-ServerActionsV293TestJSON-329717180-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a35702dbbfa4620ac760c2dedfd5582',uuid=9f46c1c0-c2b8-40cf-991f-c99735954429,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Converting VIF {"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG os_vif [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0ef7f30-63, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:25:04 user nova-compute[72818]: INFO os_vif [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63')
Aug 17 21:25:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frYIbUPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:25:04 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6617ceab-0253-4918-8a2f-0e33d6bcc84b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9d0ad9-f99a-4b6d-8dc2-d56ca31ecbbc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:04 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:25:04 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:04 user nova-compute[72818]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)
Aug 17 21:25:04 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:04 user nova-compute[72818]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:25:04 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:04 user nova-compute[72818]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)
Aug 17 21:25:04 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fa2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc'): ({'sdd'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Removing single pathed devices sdd {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Deleted allocations for instance 92f865e1-d261-47e3-a64d-dc7bc6e7a93f
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fd2b80-56da-4071-a1fa-cf2f9ac48e35]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.035s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac5e0c7-2dbc-482e-a61f-b2f577335f97]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Flushing IO for device /dev/sdd {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81176c1-5a1e-408a-83b0-00d5d7aec3af]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lazy-loading 'numa_topology' on Instance uuid 92f865e1-d261-47e3-a64d-dc7bc6e7a93f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8745e359-a46c-4701-a2a3-c9ce25de851c]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9a3237-397b-48f9-a085-9b074403207a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2474df-1604-4dcb-b9df-46fc2a91279c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260]
Aug 17 21:25:04 user nova-compute[72818]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260] successful.
Aug 17 21:25:04 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG nova.network.neutron [req-9add354f-2012-428b-a162-c81da60fef69 req-f5cb1fea-81dd-4b93-aa14-159b1167d70b service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updated VIF entry in instance network info cache for port 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG nova.network.neutron [req-9add354f-2012-428b-a162-c81da60fef69 req-f5cb1fea-81dd-4b93-aa14-159b1167d70b service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updating instance_info_cache with network_info: [{"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": null, "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2777d3ab-85c5-4d41-8023-71a42f04a1dc]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] <== disconnect_volume: return (358ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:25:04 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Deleting instance files /opt/stack/data/nova/instances/9f46c1c0-c2b8-40cf-991f-c99735954429_del
Aug 17 21:25:04 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Deletion of /opt/stack/data/nova/instances/9f46c1c0-c2b8-40cf-991f-c99735954429_del complete
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9add354f-2012-428b-a162-c81da60fef69 req-f5cb1fea-81dd-4b93-aa14-159b1167d70b service nova] Releasing lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 9f46c1c0-c2b8-40cf-991f-c99735954429 could not be found.
Aug 17 21:25:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frYIbUPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:25:04 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eb2c3a-df0b-4f15-b841-1f7f2c78178b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[166c375e-89b0-4963-a395-56fc774f81cc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:04 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:04 user nova-compute[72818]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)
Aug 17 21:25:04 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:04 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:04 user nova-compute[72818]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)
Aug 17 21:25:04 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fa92d0>, {}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Disconnecting from: [] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] <== disconnect_volume: return (54ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.566s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3df9f02-8aac-4ee3-ade6-93a915a61af3 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.925s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:05 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid '9f46c1c0-c2b8-40cf-991f-c99735954429' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid '9f46c1c0-c2b8-40cf-991f-c99735954429' (instance-00000017)
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-cd2c7f67-6e2d-4337-a6c9-199461881b9a req-e55b6a1b-1522-4885-a29f-e439696fa472 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cd2c7f67-6e2d-4337-a6c9-199461881b9a req-e55b6a1b-1522-4885-a29f-e439696fa472 service nova] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cd2c7f67-6e2d-4337-a6c9-199461881b9a req-e55b6a1b-1522-4885-a29f-e439696fa472 service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cd2c7f67-6e2d-4337-a6c9-199461881b9a req-e55b6a1b-1522-4885-a29f-e439696fa472 service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-cd2c7f67-6e2d-4337-a6c9-199461881b9a req-e55b6a1b-1522-4885-a29f-e439696fa472 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] No waiting events found dispatching network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:25:05 user nova-compute[72818]: WARNING nova.compute.manager [req-cd2c7f67-6e2d-4337-a6c9-199461881b9a req-e55b6a1b-1522-4885-a29f-e439696fa472 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received unexpected event network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a for instance with vm_state active and task_state rebuilding.
Aug 17 21:25:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Preparing to wait for external event volume-reimaged-1ab88003-1572-4052-a202-05a85d1904fc {{(pid=72818) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:06 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Error from libvirt while getting description of instance-00000016: [Error Code 42] Domain not found: no domain with matching uuid '92f865e1-d261-47e3-a64d-dc7bc6e7a93f' (instance-00000016): libvirt.libvirtError: Domain not found: no domain with matching uuid '92f865e1-d261-47e3-a64d-dc7bc6e7a93f' (instance-00000016)
Aug 17 21:25:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:06 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:25:06 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=6883MB free_disk=25.238460540771484GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 48b00603-33ea-4eaa-b445-934ba1ab88f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 774642dc-1888-4f4e-9485-b6dfe7ad6a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e8b5ccab-5dff-4458-a799-8c8528a032b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 587af1f4-36d1-4bbd-a091-b42857ee8637 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 9f46c1c0-c2b8-40cf-991f-c99735954429 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 6c46354a-2316-4703-b7fb-431fa37df1ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:25:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:25:07 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:25:07 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:25:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:25:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:25:13 user nova-compute[72818]: INFO nova.compute.manager [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] instance snapshotting
Aug 17 21:25:13 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Beginning live snapshot process
Aug 17 21:25:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json -f qcow2 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json -f qcow2 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.209s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp0i5_u4w/e50b514884d34fdc88b58f50ca470e58.delta 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp0i5_u4w/e50b514884d34fdc88b58f50ca470e58.delta 1073741824" returned: 0 in 0.049s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:14 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 21:25:14 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307499.7389033, 92f865e1-d261-47e3-a64d-dc7bc6e7a93f => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:25:14 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] VM Stopped (Lifecycle Event)
Aug 17 21:25:14 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ab4f8a16-e5c1-4d79-a599-cff33ace5430 None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:25:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72818) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 21:25:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72818) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 21:25:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 21:25:15 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:25:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp0i5_u4w/e50b514884d34fdc88b58f50ca470e58.delta /opt/stack/data/nova/instances/snapshots/tmpp0i5_u4w/e50b514884d34fdc88b58f50ca470e58 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "587af1f4-36d1-4bbd-a091-b42857ee8637" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:15 user nova-compute[72818]: INFO nova.compute.manager [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Detaching volume 214645ee-a888-4f40-a600-bba27b987fea
Aug 17 21:25:15 user nova-compute[72818]: INFO nova.virt.block_device [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Attempting to driver detach volume 214645ee-a888-4f40-a600-bba27b987fea from mountpoint /dev/vdb
Aug 17 21:25:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Attempting to detach device vdb from instance 587af1f4-36d1-4bbd-a091-b42857ee8637 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:25:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:25:15 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:25:15 user nova-compute[72818]:   <source dev="/dev/sde"/>
Aug 17 21:25:15 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:25:15 user nova-compute[72818]:   <serial>214645ee-a888-4f40-a600-bba27b987fea</serial>
Aug 17 21:25:15 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:25:15 user nova-compute[72818]: </disk>
Aug 17 21:25:15 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:25:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Successfully detached device vdb from instance 587af1f4-36d1-4bbd-a091-b42857ee8637 from the persistent domain config.
Aug 17 21:25:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 587af1f4-36d1-4bbd-a091-b42857ee8637 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:25:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:25:15 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:25:15 user nova-compute[72818]:   <source dev="/dev/sde"/>
Aug 17 21:25:15 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:25:15 user nova-compute[72818]:   <serial>214645ee-a888-4f40-a600-bba27b987fea</serial>
Aug 17 21:25:15 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:25:15 user nova-compute[72818]: </disk>
Aug 17 21:25:15 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "587af1f4-36d1-4bbd-a091-b42857ee8637" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp0i5_u4w/e50b514884d34fdc88b58f50ca470e58.delta /opt/stack/data/nova/instances/snapshots/tmpp0i5_u4w/e50b514884d34fdc88b58f50ca470e58" returned: 0 in 0.632s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:16 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Snapshot extracted, beginning image upload
Aug 17 21:25:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692307516.535387, 587af1f4-36d1-4bbd-a091-b42857ee8637 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 587af1f4-36d1-4bbd-a091-b42857ee8637 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:25:16 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Successfully detached device vdb from instance 587af1f4-36d1-4bbd-a091-b42857ee8637 from the live domain config.
Aug 17 21:25:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MPsmxOrI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:25:16 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f91111-5742-4a71-ac51-318fd545b08c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae287bc3-8997-4c7c-92a9-c81b6d0150bd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:16 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:16 user nova-compute[72818]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)
Aug 17 21:25:16 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:16 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:16 user nova-compute[72818]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea (non-flash)
Aug 17 21:25:16 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fb4d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea'): ({'sde'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Removing single pathed devices sde {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[460b4e30-41ab-4e49-b6c5-174a49d92042]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede70e94-0d79-4c81-880c-5f2f9b0448c7]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Flushing IO for device /dev/sde {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b39411-b5b3-443c-8a33-88f22032c5cd]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acb807d-eec8-4cc1-932e-136046f31563]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] SCSI volumes sde have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7059a4-7fc2-4d67-9d27-be58929ef206]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[25366b98-cd89-48c3-95af-2501ea9acfc8]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea, portal: 172.16.0.220,3260]
Aug 17 21:25:16 user nova-compute[72818]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea, portal: 172.16.0.220,3260] successful.
Aug 17 21:25:16 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04b196f-5064-4f2c-8f0b-e6661479cfeb]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] <== disconnect_volume: return (316ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:25:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:25:17 user nova-compute[72818]: DEBUG nova.objects.instance [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lazy-loading 'flavor' on Instance uuid 587af1f4-36d1-4bbd-a091-b42857ee8637 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:25:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1df01551-bcc0-48b4-a380-ca4c6a955c54 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.018s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.672s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:17 user nova-compute[72818]: INFO nova.compute.manager [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Terminating instance
Aug 17 21:25:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:25:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.compute.manager [req-f241e9c5-ab64-435c-9e9d-befb0a83bbd5 req-ec08e1e9-aff9-4aef-af68-48f4c0da72dd service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Received event network-vif-unplugged-b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f241e9c5-ab64-435c-9e9d-befb0a83bbd5 req-ec08e1e9-aff9-4aef-af68-48f4c0da72dd service nova] Acquiring lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f241e9c5-ab64-435c-9e9d-befb0a83bbd5 req-ec08e1e9-aff9-4aef-af68-48f4c0da72dd service nova] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f241e9c5-ab64-435c-9e9d-befb0a83bbd5 req-ec08e1e9-aff9-4aef-af68-48f4c0da72dd service nova] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.compute.manager [req-f241e9c5-ab64-435c-9e9d-befb0a83bbd5 req-ec08e1e9-aff9-4aef-af68-48f4c0da72dd service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] No waiting events found dispatching network-vif-unplugged-b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.compute.manager [req-f241e9c5-ab64-435c-9e9d-befb0a83bbd5 req-ec08e1e9-aff9-4aef-af68-48f4c0da72dd service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Received event network-vif-unplugged-b1c58ade-9008-4db9-9c4f-29a6b2765a1a for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:25:18 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Instance destroyed successfully.
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.objects.instance [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lazy-loading 'resources' on Instance uuid 587af1f4-36d1-4bbd-a091-b42857ee8637 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:22:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-529779464',display_name='tempest-VolumesSnapshotTestJSON-instance-529779464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-529779464',id=20,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcU4dgY9MLSuSN395Bm+eAlXk6tS6t6Iql6pHs0t2AnsYPkwCiX8ykW4AI3UxLHTbMyC9WKyyl9BjXjkOHN1nBcmTVYYDtq9dNFn5wRU9nCfpXxhj+1wnLq1KQsfFXwDg==',key_name='tempest-keypair-2031883052',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:22:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3427d284fd1446f8b7144adeef980549',ramdisk_id='',reservation_id='r-0n7g7c10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-473153764',owner_user_name='tempest-VolumesSnapshotTestJSON-473153764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:22:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44662762d7924c16aaa0dfa5c38e5983',uuid=587af1f4-36d1-4bbd-a091-b42857ee8637,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "address": "fa:16:3e:b1:57:ff", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c58ade-90", "ovs_interfaceid": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Converting VIF {"id": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "address": "fa:16:3e:b1:57:ff", "network": {"id": "2d6b20f5-c3b0-4583-a602-8dedf722a1b0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1050393964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3427d284fd1446f8b7144adeef980549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c58ade-90", "ovs_interfaceid": "b1c58ade-9008-4db9-9c4f-29a6b2765a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=b1c58ade-9008-4db9-9c4f-29a6b2765a1a,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c58ade-90') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG os_vif [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=b1c58ade-9008-4db9-9c4f-29a6b2765a1a,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c58ade-90') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1c58ade-90, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:25:18 user nova-compute[72818]: INFO os_vif [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=b1c58ade-9008-4db9-9c4f-29a6b2765a1a,network=Network(2d6b20f5-c3b0-4583-a602-8dedf722a1b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c58ade-90')
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MPsmxOrI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:25:18 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:25:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:214645ee-a888-4f40-a600-bba27b987fea', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[af16eb15-e7c4-4d29-8b41-6f1b4d9e4087]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efe2255-1198-41ec-9a36-6f541b998956]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:18 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:18 user nova-compute[72818]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:25:18 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:18 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:18 user nova-compute[72818]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:25:18 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04d85a20>, {}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Disconnecting from: [] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] <== disconnect_volume: return (53ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:25:18 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Deleting instance files /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637_del
Aug 17 21:25:18 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Deletion of /opt/stack/data/nova/instances/587af1f4-36d1-4bbd-a091-b42857ee8637_del complete
Aug 17 21:25:18 user nova-compute[72818]: INFO nova.compute.manager [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 17 21:25:18 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:25:18 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Snapshot image upload complete
Aug 17 21:25:18 user nova-compute[72818]: INFO nova.compute.manager [None req-7b9df6f2-fc8c-4aed-9a14-ecae61689088 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Took 5.40 seconds to snapshot the instance on the hypervisor.
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307503.9018564, 9f46c1c0-c2b8-40cf-991f-c99735954429 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:25:18 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] VM Stopped (Lifecycle Event)
Aug 17 21:25:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-33c5136c-bb3f-46c0-a40b-b0f39474613e None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:25:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-6eb0db10-e6c7-475b-b02f-872582f012fd req-86489122-088f-4504-915e-16bb822af3ff service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Received event network-vif-plugged-b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6eb0db10-e6c7-475b-b02f-872582f012fd req-86489122-088f-4504-915e-16bb822af3ff service nova] Acquiring lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6eb0db10-e6c7-475b-b02f-872582f012fd req-86489122-088f-4504-915e-16bb822af3ff service nova] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6eb0db10-e6c7-475b-b02f-872582f012fd req-86489122-088f-4504-915e-16bb822af3ff service nova] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-6eb0db10-e6c7-475b-b02f-872582f012fd req-86489122-088f-4504-915e-16bb822af3ff service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] No waiting events found dispatching network-vif-plugged-b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:25:20 user nova-compute[72818]: WARNING nova.compute.manager [req-6eb0db10-e6c7-475b-b02f-872582f012fd req-86489122-088f-4504-915e-16bb822af3ff service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Received unexpected event network-vif-plugged-b1c58ade-9008-4db9-9c4f-29a6b2765a1a for instance with vm_state active and task_state deleting.
Aug 17 21:25:20 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:25:20 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Took 1.47 seconds to deallocate network for instance.
Aug 17 21:25:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-cd435032-200e-4987-8287-36f176aa509e req-729d5478-032f-47b5-9681-2367a66e3dee service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Received event network-vif-deleted-b1c58ade-9008-4db9-9c4f-29a6b2765a1a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:20 user nova-compute[72818]: INFO nova.compute.manager [req-cd435032-200e-4987-8287-36f176aa509e req-729d5478-032f-47b5-9681-2367a66e3dee service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Neutron deleted interface b1c58ade-9008-4db9-9c4f-29a6b2765a1a; detaching it from the instance and deleting it from the info cache
Aug 17 21:25:20 user nova-compute[72818]: DEBUG nova.network.neutron [req-cd435032-200e-4987-8287-36f176aa509e req-729d5478-032f-47b5-9681-2367a66e3dee service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:25:20 user nova-compute[72818]: WARNING nova.volume.cinder [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Attachment 0c91f7ff-79be-4014-bb06-24b7b1111a1a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0c91f7ff-79be-4014-bb06-24b7b1111a1a. (HTTP 404) (Request-ID: req-52b916c1-7656-4204-871c-6d3dba22333d)
Aug 17 21:25:20 user nova-compute[72818]: INFO nova.compute.manager [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Took 0.04 seconds to detach 1 volumes for instance.
Aug 17 21:25:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-cd435032-200e-4987-8287-36f176aa509e req-729d5478-032f-47b5-9681-2367a66e3dee service nova] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Detach interface failed, port_id=b1c58ade-9008-4db9-9c4f-29a6b2765a1a, reason: Instance 587af1f4-36d1-4bbd-a091-b42857ee8637 could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:25:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:20 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:25:20 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:25:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:20 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Deleted allocations for instance 587af1f4-36d1-4bbd-a091-b42857ee8637
Aug 17 21:25:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3b7f61b9-4a65-425e-aa72-ee899674abd4 tempest-VolumesSnapshotTestJSON-473153764 tempest-VolumesSnapshotTestJSON-473153764-project-member] Lock "587af1f4-36d1-4bbd-a091-b42857ee8637" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.344s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:25:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:25:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:25:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:25:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 req-e8d37700-27e9-463f-9e39-17d6dfecada9 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event volume-reimaged-1ab88003-1572-4052-a202-05a85d1904fc {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 req-e8d37700-27e9-463f-9e39-17d6dfecada9 service nova] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 req-e8d37700-27e9-463f-9e39-17d6dfecada9 service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 req-e8d37700-27e9-463f-9e39-17d6dfecada9 service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 req-e8d37700-27e9-463f-9e39-17d6dfecada9 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Processing event volume-reimaged-1ab88003-1572-4052-a202-05a85d1904fc {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:25:26 user nova-compute[72818]: INFO nova.virt.block_device [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Booting with volume 1ab88003-1572-4052-a202-05a85d1904fc at /dev/vda
Aug 17 21:25:26 user nova-compute[72818]: DEBUG os_brick.utils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b244064-c148-4853-a326-92d015f5ba9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[510871ba-5087-40a1-96b2-38a627c2e06d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf204f3-c28a-4e33-a331-ebd1b0f5a53c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad68f69b-e515-42cd-a0f6-f26b36b91014]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:25:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:25:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:25:27 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:25:27 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd4da70-3d65-4365-9099-e62fa0fe856a]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:25:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:25:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:25:27 user nova-compute[72818]: DEBUG os_brick.utils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:25:27 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Updating existing volume attachment record: c11f9748-8d5c-4b21-9cc0-fa4ea7a9bc5a {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:25:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-75e6bf71-900d-498b-a125-01ce2558d47c req-13002f0f-ef63-4b2a-a90c-4e31464de1a4 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Received event network-changed-b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-75e6bf71-900d-498b-a125-01ce2558d47c req-13002f0f-ef63-4b2a-a90c-4e31464de1a4 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Refreshing instance network info cache due to event network-changed-b1871d19-ffff-4ade-99b9-9e0355b5120a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-75e6bf71-900d-498b-a125-01ce2558d47c req-13002f0f-ef63-4b2a-a90c-4e31464de1a4 service nova] Acquiring lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-75e6bf71-900d-498b-a125-01ce2558d47c req-13002f0f-ef63-4b2a-a90c-4e31464de1a4 service nova] Acquired lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG nova.network.neutron [req-75e6bf71-900d-498b-a125-01ce2558d47c req-13002f0f-ef63-4b2a-a90c-4e31464de1a4 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Refreshing network info cache for port b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:32 user nova-compute[72818]: INFO nova.compute.manager [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Terminating instance
Aug 17 21:25:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG nova.network.neutron [req-75e6bf71-900d-498b-a125-01ce2558d47c req-13002f0f-ef63-4b2a-a90c-4e31464de1a4 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Updated VIF entry in instance network info cache for port b1871d19-ffff-4ade-99b9-9e0355b5120a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG nova.network.neutron [req-75e6bf71-900d-498b-a125-01ce2558d47c req-13002f0f-ef63-4b2a-a90c-4e31464de1a4 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Updating instance_info_cache with network_info: [{"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-75e6bf71-900d-498b-a125-01ce2558d47c req-13002f0f-ef63-4b2a-a90c-4e31464de1a4 service nova] Releasing lock "refresh_cache-48b00603-33ea-4eaa-b445-934ba1ab88f4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:25:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Instance destroyed successfully.
Aug 17 21:25:33 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lazy-loading 'resources' on Instance uuid 48b00603-33ea-4eaa-b445-934ba1ab88f4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1398987713',display_name='tempest-TestStampPattern-server-1398987713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1398987713',id=10,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOg12rwG0goFcEOqfjeVkLRdQHA4VYmkHTOdp9mo/FLMqnHH8awtzuou6HfZ30eiO4Lj+EDhkp42MExzTbcAj8c21NG1Hgsi9ewpnMwejZ3D3SuTfwK1a/C6Q0zNej4H8Q==',key_name='tempest-TestStampPattern-158492147',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:17:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ae77104eaa942eca3d579618e78ccc9',ramdisk_id='',reservation_id='r-qzbcclig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1752250551',owner_user_name='tempest-TestStampPattern-1752250551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:20:30Z,user_data=None,user_id='790700df1c8549699854d5a0aa6e5566',uuid=48b00603-33ea-4eaa-b445-934ba1ab88f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Converting VIF {"id": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "address": "fa:16:3e:97:44:93", "network": {"id": "44c46bbd-d530-4965-96f8-4b69c1b103c0", "bridge": "br-int", "label": "tempest-TestStampPattern-958825754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae77104eaa942eca3d579618e78ccc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1871d19-ff", "ovs_interfaceid": "b1871d19-ffff-4ade-99b9-9e0355b5120a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:44:93,bridge_name='br-int',has_traffic_filtering=True,id=b1871d19-ffff-4ade-99b9-9e0355b5120a,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1871d19-ff') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG os_vif [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:44:93,bridge_name='br-int',has_traffic_filtering=True,id=b1871d19-ffff-4ade-99b9-9e0355b5120a,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1871d19-ff') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1871d19-ff, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:33 user nova-compute[72818]: INFO os_vif [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:44:93,bridge_name='br-int',has_traffic_filtering=True,id=b1871d19-ffff-4ade-99b9-9e0355b5120a,network=Network(44c46bbd-d530-4965-96f8-4b69c1b103c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1871d19-ff')
Aug 17 21:25:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Deleting instance files /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4_del
Aug 17 21:25:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Deletion of /opt/stack/data/nova/instances/48b00603-33ea-4eaa-b445-934ba1ab88f4_del complete
Aug 17 21:25:33 user nova-compute[72818]: INFO nova.compute.manager [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 21:25:33 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307518.5663524, 587af1f4-36d1-4bbd-a091-b42857ee8637 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:25:33 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] VM Stopped (Lifecycle Event)
Aug 17 21:25:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-618b4571-a752-4660-8572-c3d89693addb None None] [instance: 587af1f4-36d1-4bbd-a091-b42857ee8637] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:25:33 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Took 0.45 seconds to deallocate network for instance.
Aug 17 21:25:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-058c3937-998e-448d-bebd-3919fb5bea49 req-25bf9f6e-90f7-4aba-a545-24d061fd2490 service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Received event network-vif-deleted-b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:34 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:25:34 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:25:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:34 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Deleted allocations for instance 48b00603-33ea-4eaa-b445-934ba1ab88f4
Aug 17 21:25:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ff248628-7fab-4cc0-8f8d-9dbe59d6c4e8 tempest-TestStampPattern-1752250551 tempest-TestStampPattern-1752250551-project-member] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.918s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-f1637bbf-acfe-492f-8029-367426cf6b94 req-1490069b-d4da-4520-8cc9-47f90203d61d service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Received event network-vif-unplugged-b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f1637bbf-acfe-492f-8029-367426cf6b94 req-1490069b-d4da-4520-8cc9-47f90203d61d service nova] Acquiring lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f1637bbf-acfe-492f-8029-367426cf6b94 req-1490069b-d4da-4520-8cc9-47f90203d61d service nova] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f1637bbf-acfe-492f-8029-367426cf6b94 req-1490069b-d4da-4520-8cc9-47f90203d61d service nova] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-f1637bbf-acfe-492f-8029-367426cf6b94 req-1490069b-d4da-4520-8cc9-47f90203d61d service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] No waiting events found dispatching network-vif-unplugged-b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:25:34 user nova-compute[72818]: WARNING nova.compute.manager [req-f1637bbf-acfe-492f-8029-367426cf6b94 req-1490069b-d4da-4520-8cc9-47f90203d61d service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Received unexpected event network-vif-unplugged-b1871d19-ffff-4ade-99b9-9e0355b5120a for instance with vm_state deleted and task_state None.
Aug 17 21:25:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-f1637bbf-acfe-492f-8029-367426cf6b94 req-1490069b-d4da-4520-8cc9-47f90203d61d service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Received event network-vif-plugged-b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f1637bbf-acfe-492f-8029-367426cf6b94 req-1490069b-d4da-4520-8cc9-47f90203d61d service nova] Acquiring lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f1637bbf-acfe-492f-8029-367426cf6b94 req-1490069b-d4da-4520-8cc9-47f90203d61d service nova] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f1637bbf-acfe-492f-8029-367426cf6b94 req-1490069b-d4da-4520-8cc9-47f90203d61d service nova] Lock "48b00603-33ea-4eaa-b445-934ba1ab88f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-f1637bbf-acfe-492f-8029-367426cf6b94 req-1490069b-d4da-4520-8cc9-47f90203d61d service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] No waiting events found dispatching network-vif-plugged-b1871d19-ffff-4ade-99b9-9e0355b5120a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:25:34 user nova-compute[72818]: WARNING nova.compute.manager [req-f1637bbf-acfe-492f-8029-367426cf6b94 req-1490069b-d4da-4520-8cc9-47f90203d61d service nova] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Received unexpected event network-vif-plugged-b1871d19-ffff-4ade-99b9-9e0355b5120a for instance with vm_state deleted and task_state None.
Aug 17 21:25:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:25:38 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Creating image(s)
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Ensure instance console log exists: /opt/stack/data/nova/instances/9f46c1c0-c2b8-40cf-991f-c99735954429/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Start _get_guest_xml network_info=[{"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'c11f9748-8d5c-4b21-9cc0-fa4ea7a9bc5a', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frYIbUPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f46c1c0-c2b8-40cf-991f-c99735954429', 'attached_at': '', 'detached_at': '', 'volume_id': '1ab88003-1572-4052-a202-05a85d1904fc', 'serial': '1ab88003-1572-4052-a202-05a85d1904fc'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:25:38 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 21:25:38 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f46c1c0-c2b8-40cf-991f-c99735954429 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frYIbUPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:25:38 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:25:38 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:25:38 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:25:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80263e9-c459-4042-aa64-eb426bebc98a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:25:38 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[80343fec-e7ec-48b1-9950-b0ddf23a61d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc] added
Aug 17 21:25:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea18e90-618d-483c-96b4-0aaf9f7e8741]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92ffa8a-40b1-4534-8c2c-2ac6815dcece]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frYIbUPh {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frYIbUPh" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ea4338-ddf0-4e5f-908a-aca78960ae0a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'frYIbUPh'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6094bec5-584a-4ee0-9727-76f3e9a2d737]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76c3acf-44de-4b53-948d-25bb81097562]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:38 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:38 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[90270dfb-2997-45a2-b98d-d1687520a1fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260]
Aug 17 21:25:38 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260] successful.
Aug 17 21:25:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d569086-77f3-48b8-9a84-1ccefd3ec19f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0a648b-f204-4277-9033-ea7d26a7fc50]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:38 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:38 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:25:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:25:38 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:25:38 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:25:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f65830f-c213-47ea-88da-00c8352ce55c]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frYIbUPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23739613362353566', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739613362353566', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-770936818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2060472075',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK9sJ2eq4o1JXfewQMshfkbC/kWFIvZxaJPcJLK3eMuQLLKsKNEtt9xLpxeN3txHMhagw7dYKiIeNu3aT7ClMUBqylRglK6VlcEfzYrHDU428DAM8IN/BPX4mbewJMS+Q==',key_name='tempest-keypair-741246036',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ba1c61f7c2e4fd5a5a15bf69db27050',ramdisk_id='',reservation_id='r-rmts4810',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-329717180',owner_user_name='tempest-ServerActionsV293TestJSON-329717180-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:25:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a35702dbbfa4620ac760c2dedfd5582',uuid=9f46c1c0-c2b8-40cf-991f-c99735954429,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Converting VIF {"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:25:39 user nova-compute[72818]:   <uuid>9f46c1c0-c2b8-40cf-991f-c99735954429</uuid>
Aug 17 21:25:39 user nova-compute[72818]:   <name>instance-00000017</name>
Aug 17 21:25:39 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:25:39 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:25:39 user nova-compute[72818]:   <metadata>
Aug 17 21:25:39 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:25:39 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:25:39 user nova-compute[72818]:       <nova:name>tempest-ServerActionsV293TestJSON-server-770936818</nova:name>
Aug 17 21:25:39 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:25:38</nova:creationTime>
Aug 17 21:25:39 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:25:39 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:25:39 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:25:39 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:25:39 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:25:39 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:25:39 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:25:39 user nova-compute[72818]:       <nova:owner>
Aug 17 21:25:39 user nova-compute[72818]:         <nova:user uuid="3a35702dbbfa4620ac760c2dedfd5582">tempest-ServerActionsV293TestJSON-329717180-project-member</nova:user>
Aug 17 21:25:39 user nova-compute[72818]:         <nova:project uuid="2ba1c61f7c2e4fd5a5a15bf69db27050">tempest-ServerActionsV293TestJSON-329717180</nova:project>
Aug 17 21:25:39 user nova-compute[72818]:       </nova:owner>
Aug 17 21:25:39 user nova-compute[72818]:       <nova:ports>
Aug 17 21:25:39 user nova-compute[72818]:         <nova:port uuid="c0ef7f30-6392-41c4-9d25-03f33cf3766a">
Aug 17 21:25:39 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 21:25:39 user nova-compute[72818]:         </nova:port>
Aug 17 21:25:39 user nova-compute[72818]:       </nova:ports>
Aug 17 21:25:39 user nova-compute[72818]:     </nova:instance>
Aug 17 21:25:39 user nova-compute[72818]:   </metadata>
Aug 17 21:25:39 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:25:39 user nova-compute[72818]:     <system>
Aug 17 21:25:39 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:25:39 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:25:39 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:25:39 user nova-compute[72818]:       <entry name="serial">9f46c1c0-c2b8-40cf-991f-c99735954429</entry>
Aug 17 21:25:39 user nova-compute[72818]:       <entry name="uuid">9f46c1c0-c2b8-40cf-991f-c99735954429</entry>
Aug 17 21:25:39 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:25:39 user nova-compute[72818]:     </system>
Aug 17 21:25:39 user nova-compute[72818]:   </sysinfo>
Aug 17 21:25:39 user nova-compute[72818]:   <os>
Aug 17 21:25:39 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:25:39 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:25:39 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:25:39 user nova-compute[72818]:   </os>
Aug 17 21:25:39 user nova-compute[72818]:   <features>
Aug 17 21:25:39 user nova-compute[72818]:     <acpi/>
Aug 17 21:25:39 user nova-compute[72818]:     <apic/>
Aug 17 21:25:39 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:25:39 user nova-compute[72818]:   </features>
Aug 17 21:25:39 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:25:39 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:25:39 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:25:39 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:25:39 user nova-compute[72818]:   </clock>
Aug 17 21:25:39 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:25:39 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:25:39 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:25:39 user nova-compute[72818]:   </cpu>
Aug 17 21:25:39 user nova-compute[72818]:   <devices>
Aug 17 21:25:39 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:25:39 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:25:39 user nova-compute[72818]:       <source dev="/dev/sdc"/>
Aug 17 21:25:39 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:25:39 user nova-compute[72818]:       <serial>1ab88003-1572-4052-a202-05a85d1904fc</serial>
Aug 17 21:25:39 user nova-compute[72818]:     </disk>
Aug 17 21:25:39 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:25:39 user nova-compute[72818]:       <mac address="fa:16:3e:c3:cc:b0"/>
Aug 17 21:25:39 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:25:39 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:25:39 user nova-compute[72818]:       <target dev="tapc0ef7f30-63"/>
Aug 17 21:25:39 user nova-compute[72818]:     </interface>
Aug 17 21:25:39 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:25:39 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/9f46c1c0-c2b8-40cf-991f-c99735954429/console.log" append="off"/>
Aug 17 21:25:39 user nova-compute[72818]:     </serial>
Aug 17 21:25:39 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:25:39 user nova-compute[72818]:     <video>
Aug 17 21:25:39 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:25:39 user nova-compute[72818]:     </video>
Aug 17 21:25:39 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:25:39 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:25:39 user nova-compute[72818]:     </rng>
Aug 17 21:25:39 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:25:39 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:25:39 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:25:39 user nova-compute[72818]:     </memballoon>
Aug 17 21:25:39 user nova-compute[72818]:   </devices>
Aug 17 21:25:39 user nova-compute[72818]: </domain>
Aug 17 21:25:39 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-770936818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2060472075',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK9sJ2eq4o1JXfewQMshfkbC/kWFIvZxaJPcJLK3eMuQLLKsKNEtt9xLpxeN3txHMhagw7dYKiIeNu3aT7ClMUBqylRglK6VlcEfzYrHDU428DAM8IN/BPX4mbewJMS+Q==',key_name='tempest-keypair-741246036',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ba1c61f7c2e4fd5a5a15bf69db27050',ramdisk_id='',reservation_id='r-rmts4810',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-329717180',owner_user_name='tempest-ServerActionsV293TestJSON-329717180-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:25:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a35702dbbfa4620ac760c2dedfd5582',uuid=9f46c1c0-c2b8-40cf-991f-c99735954429,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Converting VIF {"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG os_vif [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0ef7f30-63, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0ef7f30-63, col_values=(('external_ids', {'iface-id': 'c0ef7f30-6392-41c4-9d25-03f33cf3766a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:cc:b0', 'vm-uuid': '9f46c1c0-c2b8-40cf-991f-c99735954429'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:39 user nova-compute[72818]: INFO os_vif [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63')
Aug 17 21:25:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:25:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] No VIF found with MAC fa:16:3e:c3:cc:b0, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:25:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-926f4350-db80-4555-96f0-239796147675 req-cc1c07e8-7e11-4ebe-aa2c-dafaf5c81b8a service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-926f4350-db80-4555-96f0-239796147675 req-cc1c07e8-7e11-4ebe-aa2c-dafaf5c81b8a service nova] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-926f4350-db80-4555-96f0-239796147675 req-cc1c07e8-7e11-4ebe-aa2c-dafaf5c81b8a service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-926f4350-db80-4555-96f0-239796147675 req-cc1c07e8-7e11-4ebe-aa2c-dafaf5c81b8a service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-926f4350-db80-4555-96f0-239796147675 req-cc1c07e8-7e11-4ebe-aa2c-dafaf5c81b8a service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] No waiting events found dispatching network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:25:41 user nova-compute[72818]: WARNING nova.compute.manager [req-926f4350-db80-4555-96f0-239796147675 req-cc1c07e8-7e11-4ebe-aa2c-dafaf5c81b8a service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received unexpected event network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a for instance with vm_state active and task_state rebuild_spawning.
Aug 17 21:25:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307543.1637442, 9f46c1c0-c2b8-40cf-991f-c99735954429 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:25:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] VM Resumed (Lifecycle Event)
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:25:43 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Instance spawned successfully.
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:25:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307543.167222, 9f46c1c0-c2b8-40cf-991f-c99735954429 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:25:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] VM Started (Lifecycle Event)
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-b1d414e5-67ff-49af-8cb7-f661f7fbfc45 req-223e71e8-790b-4c98-b88c-174c8180022e service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b1d414e5-67ff-49af-8cb7-f661f7fbfc45 req-223e71e8-790b-4c98-b88c-174c8180022e service nova] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b1d414e5-67ff-49af-8cb7-f661f7fbfc45 req-223e71e8-790b-4c98-b88c-174c8180022e service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b1d414e5-67ff-49af-8cb7-f661f7fbfc45 req-223e71e8-790b-4c98-b88c-174c8180022e service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-b1d414e5-67ff-49af-8cb7-f661f7fbfc45 req-223e71e8-790b-4c98-b88c-174c8180022e service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] No waiting events found dispatching network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:25:43 user nova-compute[72818]: WARNING nova.compute.manager [req-b1d414e5-67ff-49af-8cb7-f661f7fbfc45 req-223e71e8-790b-4c98-b88c-174c8180022e service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received unexpected event network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a for instance with vm_state active and task_state rebuild_spawning.
Aug 17 21:25:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72818) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 21:25:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b4349d65-b1c1-4022-b76c-cdcbe8eecfd4 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.066s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:48 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307533.1792731, 48b00603-33ea-4eaa-b445-934ba1ab88f4 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:25:48 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] VM Stopped (Lifecycle Event)
Aug 17 21:25:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c87b31f9-243d-4fe6-bb72-60449c9262ec None None] [instance: 48b00603-33ea-4eaa-b445-934ba1ab88f4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:25:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:52 user nova-compute[72818]: DEBUG nova.compute.manager [req-ef56a9e2-d88c-4275-8593-6005b8d21d06 req-260d6cd9-5833-4ef3-a2f0-053490b4887d service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-changed-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:25:52 user nova-compute[72818]: DEBUG nova.compute.manager [req-ef56a9e2-d88c-4275-8593-6005b8d21d06 req-260d6cd9-5833-4ef3-a2f0-053490b4887d service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Refreshing instance network info cache due to event network-changed-9576b57c-48c9-4fe8-bfc8-17876b941e67. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:25:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ef56a9e2-d88c-4275-8593-6005b8d21d06 req-260d6cd9-5833-4ef3-a2f0-053490b4887d service nova] Acquiring lock "refresh_cache-8ab794f2-ef30-4524-8eea-224873d6f0b5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:25:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ef56a9e2-d88c-4275-8593-6005b8d21d06 req-260d6cd9-5833-4ef3-a2f0-053490b4887d service nova] Acquired lock "refresh_cache-8ab794f2-ef30-4524-8eea-224873d6f0b5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:25:52 user nova-compute[72818]: DEBUG nova.network.neutron [req-ef56a9e2-d88c-4275-8593-6005b8d21d06 req-260d6cd9-5833-4ef3-a2f0-053490b4887d service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Refreshing network info cache for port 9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG nova.objects.instance [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'flavor' on Instance uuid 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG nova.network.neutron [req-ef56a9e2-d88c-4275-8593-6005b8d21d06 req-260d6cd9-5833-4ef3-a2f0-053490b4887d service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Updated VIF entry in instance network info cache for port 9576b57c-48c9-4fe8-bfc8-17876b941e67. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG nova.network.neutron [req-ef56a9e2-d88c-4275-8593-6005b8d21d06 req-260d6cd9-5833-4ef3-a2f0-053490b4887d service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Updating instance_info_cache with network_info: [{"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ef56a9e2-d88c-4275-8593-6005b8d21d06 req-260d6cd9-5833-4ef3-a2f0-053490b4887d service nova] Releasing lock "refresh_cache-8ab794f2-ef30-4524-8eea-224873d6f0b5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:53 user nova-compute[72818]: INFO nova.compute.manager [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Attaching volume 3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 to /dev/vdb
Aug 17 21:25:53 user nova-compute[72818]: DEBUG os_brick.utils [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ce9d52-db55-4ebb-9b4e-9aef6be1543f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff1f699-0920-4548-abca-0e3b63c56727]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a085b437-744d-45c7-937b-75d4f4aab447]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a650697-834a-41e6-969b-dd3772a31242]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:25:53 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:25:53 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8564983-8e13-4641-99df-b27a50aaa5f0]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG os_brick.utils [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:25:53 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Updating existing volume attachment record: 90fdf5fd-81f2-48be-b6cf-c421e23d8272 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:25:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:25:54 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:54 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:55 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:56 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:25:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:25:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:25:56 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:25:57 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Updating instance_info_cache with network_info: [{"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:25:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:25:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:25:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72818) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 21:25:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:25:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:25:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:25:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:25:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:25:59 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:26:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:26:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:26:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:01 user nova-compute[72818]: INFO nova.compute.manager [None req-ed01586a-f83b-4a4f-9b51-ddced90fb084 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Unrescuing
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed01586a-f83b-4a4f-9b51-ddced90fb084 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed01586a-f83b-4a4f-9b51-ddced90fb084 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquired lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ed01586a-f83b-4a4f-9b51-ddced90fb084 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ed01586a-f83b-4a4f-9b51-ddced90fb084 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Updating instance_info_cache with network_info: [{"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ed01586a-f83b-4a4f-9b51-ddced90fb084 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Releasing lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ed01586a-f83b-4a4f-9b51-ddced90fb084 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'flavor' on Instance uuid 4b43de5d-62c1-4368-8a77-59899ae0b16d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-2bf10e69-e379-4faa-b454-1e3905fdaf4d req-8834c20f-c767-4581-80a9-e90782550bad service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-unplugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2bf10e69-e379-4faa-b454-1e3905fdaf4d req-8834c20f-c767-4581-80a9-e90782550bad service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2bf10e69-e379-4faa-b454-1e3905fdaf4d req-8834c20f-c767-4581-80a9-e90782550bad service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2bf10e69-e379-4faa-b454-1e3905fdaf4d req-8834c20f-c767-4581-80a9-e90782550bad service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-2bf10e69-e379-4faa-b454-1e3905fdaf4d req-8834c20f-c767-4581-80a9-e90782550bad service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-unplugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:02 user nova-compute[72818]: WARNING nova.compute.manager [req-2bf10e69-e379-4faa-b454-1e3905fdaf4d req-8834c20f-c767-4581-80a9-e90782550bad service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-unplugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:26:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Instance destroyed successfully.
Aug 17 21:26:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-c90cf28c-f7e1-4300-b3aa-68d6334851ab req-7a332671-7273-4900-9be2-6f839c65edb2 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c90cf28c-f7e1-4300-b3aa-68d6334851ab req-7a332671-7273-4900-9be2-6f839c65edb2 service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c90cf28c-f7e1-4300-b3aa-68d6334851ab req-7a332671-7273-4900-9be2-6f839c65edb2 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c90cf28c-f7e1-4300-b3aa-68d6334851ab req-7a332671-7273-4900-9be2-6f839c65edb2 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-c90cf28c-f7e1-4300-b3aa-68d6334851ab req-7a332671-7273-4900-9be2-6f839c65edb2 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:04 user nova-compute[72818]: WARNING nova.compute.manager [req-c90cf28c-f7e1-4300-b3aa-68d6334851ab req-7a332671-7273-4900-9be2-6f839c65edb2 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:26:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-c90cf28c-f7e1-4300-b3aa-68d6334851ab req-7a332671-7273-4900-9be2-6f839c65edb2 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c90cf28c-f7e1-4300-b3aa-68d6334851ab req-7a332671-7273-4900-9be2-6f839c65edb2 service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c90cf28c-f7e1-4300-b3aa-68d6334851ab req-7a332671-7273-4900-9be2-6f839c65edb2 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c90cf28c-f7e1-4300-b3aa-68d6334851ab req-7a332671-7273-4900-9be2-6f839c65edb2 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-c90cf28c-f7e1-4300-b3aa-68d6334851ab req-7a332671-7273-4900-9be2-6f839c65edb2 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:04 user nova-compute[72818]: WARNING nova.compute.manager [req-c90cf28c-f7e1-4300-b3aa-68d6334851ab req-7a332671-7273-4900-9be2-6f839c65edb2 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:26:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for 4b43de5d-62c1-4368-8a77-59899ae0b16d due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307566.31941, 4b43de5d-62c1-4368-8a77-59899ae0b16d => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:26:06 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] VM Resumed (Lifecycle Event)
Aug 17 21:26:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-a0de6415-0b20-4b37-8088-617f8a4538d9 req-b3f6725f-6bd9-46f5-bd2c-4cbe5fd11427 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0de6415-0b20-4b37-8088-617f8a4538d9 req-b3f6725f-6bd9-46f5-bd2c-4cbe5fd11427 service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0de6415-0b20-4b37-8088-617f8a4538d9 req-b3f6725f-6bd9-46f5-bd2c-4cbe5fd11427 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0de6415-0b20-4b37-8088-617f8a4538d9 req-b3f6725f-6bd9-46f5-bd2c-4cbe5fd11427 service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-a0de6415-0b20-4b37-8088-617f8a4538d9 req-b3f6725f-6bd9-46f5-bd2c-4cbe5fd11427 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:06 user nova-compute[72818]: WARNING nova.compute.manager [req-a0de6415-0b20-4b37-8088-617f8a4538d9 req-b3f6725f-6bd9-46f5-bd2c-4cbe5fd11427 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:26:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ed01586a-f83b-4a4f-9b51-ddced90fb084 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRFeihWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:26:06 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:26:06 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:26:06 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca11a713-5245-44ca-a69e-6fe635688de2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:26:06 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:06 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:26:06 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:26:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7333MB free_disk=25.339248657226562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fd7f3c-71d7-4991-be89-166559f03af2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70] added
Aug 17 21:26:06 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:06 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 21:26:06 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307566.3207479, 4b43de5d-62c1-4368-8a77-59899ae0b16d => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:26:06 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] VM Started (Lifecycle Event)
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7feade5-fb3f-4745-968e-9b67ae13bb07]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[97633566-b5ed-49ed-ae7f-c7a6201a59f4]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRFeihWp {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRFeihWp" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e10daa-c3b7-41ef-9245-3a7fbed7814c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jRFeihWp'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa3b3d8-b6a1-4275-accc-92832f021dc8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[691c477f-0f42-498a-878d-3b47a5ae8ddd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:06 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:06 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:06 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:06 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:06 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:06 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:26:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e4a0dd-2d6e-4aca-85cb-b0f9283fb731]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260]
Aug 17 21:26:07 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260] successful.
Aug 17 21:26:07 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.048s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf754d0-5fec-473f-b5fb-34b3ebf9e8e4]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[291ce8a6-b561-45bd-b459-ef2895c73079]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:07 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:07 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:07 user nova-compute[72818]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:26:07 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:07 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:07 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:07 user nova-compute[72818]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:26:07 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 774642dc-1888-4f4e-9485-b6dfe7ad6a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e8b5ccab-5dff-4458-a799-8c8528a032b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 9f46c1c0-c2b8-40cf-991f-c99735954429 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 6c46354a-2316-4703-b7fb-431fa37df1ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2792aa1-c8ae-4cdc-b27b-eb42f4018fdd]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRFeihWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing inventories for resource provider d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating ProviderTree inventory for provider d156e3af-684d-47e1-a951-585f9c95fa46 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing aggregate associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, aggregates: None {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing trait associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.019s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 21:26:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] There are 0 instances to clean {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 21:26:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:26:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '23437383464653232', 'path': '/dev/sdd'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:26:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437383464653232', 'path': '/dev/sdd'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:26:08 user nova-compute[72818]: DEBUG nova.objects.instance [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'flavor' on Instance uuid 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:26:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:26:08 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:26:08 user nova-compute[72818]:   <source dev="/dev/sdd"/>
Aug 17 21:26:08 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:26:08 user nova-compute[72818]:   <serial>3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70</serial>
Aug 17 21:26:08 user nova-compute[72818]: </disk>
Aug 17 21:26:08 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:26:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:26:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:26:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] No VIF found with MAC fa:16:3e:61:46:e5, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:26:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-435f7284-7220-4669-ac28-ac7e188f001b tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.308s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:10 user nova-compute[72818]: INFO nova.compute.manager [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Rebuilding instance
Aug 17 21:26:10 user nova-compute[72818]: DEBUG nova.objects.instance [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:26:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:26:10 user nova-compute[72818]: DEBUG nova.objects.instance [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'pci_requests' on Instance uuid 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:26:10 user nova-compute[72818]: DEBUG nova.objects.instance [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:26:10 user nova-compute[72818]: DEBUG nova.objects.instance [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'resources' on Instance uuid 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:26:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:26:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:26:10 user nova-compute[72818]: DEBUG nova.objects.instance [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'migration_context' on Instance uuid 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:26:10 user nova-compute[72818]: DEBUG nova.objects.instance [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72818) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 21:26:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:11 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Instance destroyed successfully.
Aug 17 21:26:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:11 user nova-compute[72818]: INFO nova.compute.manager [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Detaching volume 3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70
Aug 17 21:26:11 user nova-compute[72818]: INFO nova.virt.block_device [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Attempting to driver detach volume 3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 from mountpoint /dev/vdb
Aug 17 21:26:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Attempting to detach device vdb from instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:26:11 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:26:11 user nova-compute[72818]:   <source dev="/dev/sdd"/>
Aug 17 21:26:11 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:26:11 user nova-compute[72818]:   <serial>3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70</serial>
Aug 17 21:26:11 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:26:11 user nova-compute[72818]: </disk>
Aug 17 21:26:11 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:26:11 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Successfully detached device vdb from instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 from the persistent domain config.
Aug 17 21:26:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRFeihWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:26:11 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 21:26:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[774c3ee0-254d-4f04-8683-85aaf6602518]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5884cdb9-cc99-42d8-b908-6bcc9b1b4e39]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:12 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:12 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:12 user nova-compute[72818]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:26:12 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:12 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:12 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:12 user nova-compute[72818]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:26:12 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f286911b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70'): ({'sdd'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Removing single pathed devices sdd {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[861856ab-dfc7-401e-988c-73cdcc0ea6e4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[05230e00-210a-4c80-a2de-80d1e2f41861]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Flushing IO for device /dev/sdd {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bd957e-559d-4b7d-b6fa-26efd08523b9]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d076d836-e915-445b-995f-e22e522aa26e]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[744e1f55-019e-4693-8cdd-c74033b56b41]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5683b8f6-f355-4a53-8dee-884b11140a93]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260]
Aug 17 21:26:12 user nova-compute[72818]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260] successful.
Aug 17 21:26:12 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2616fe8-1d2e-403f-b743-969ef90149bd]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] <== disconnect_volume: return (333ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:26:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:13 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Instance destroyed successfully.
Aug 17 21:26:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1842332389',display_name='tempest-ServerActionsTestOtherA-server-1272518972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1842332389',id=25,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLocLU8TRDAiLi3GdKktq0nWqdk7D1keSlsLXc1XBv8DJ5eY9kzsxQScXcrArgHMHu1A1J4D/TdCnI8XhIYNw2UvB+RykgPVyRzvdlRj00o3UKrPopaD5xejUX+15fusg==',key_name='tempest-keypair-904493785',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:24:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-igol0v2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:26:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=8ab794f2-ef30-4524-8eea-224873d6f0b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_vif [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9576b57c-48, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:13 user nova-compute[72818]: INFO os_vif [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48')
Aug 17 21:26:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRFeihWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:26:13 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a31101d-ff2e-40c6-9ac2-eba236773b95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45da428-34d6-4bc6-a226-33c4fa3b79a5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:13 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:13 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:13 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:13 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04e50b80>, {}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Disconnecting from: [] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] <== disconnect_volume: return (54ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:26:13 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Deleting instance files /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5_del
Aug 17 21:26:13 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Deletion of /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5_del complete
Aug 17 21:26:13 user nova-compute[72818]: INFO nova.virt.block_device [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Booting with volume 3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 at /dev/vdb
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.utils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[130627cf-0eab-431e-b7b0-5e25b4e2299d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[959b292f-654a-4468-812c-8999351bc1c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7243ffb-593c-4072-8c77-16248869f80e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96c72ef-6193-4313-a5c7-8eed8eb1f2a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:26:13 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:26:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[350d64d0-b13a-40dc-b60c-990c1c9c4ea5]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG os_brick.utils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:26:13 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Updating existing volume attachment record: 548b2be1-be16-438f-bd04-17d4728661e9 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:26:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-175abaf9-40b5-493a-b0d0-ff24df93d16a req-90eb07a6-eb8d-473a-adf8-d4c2c6564445 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-unplugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-175abaf9-40b5-493a-b0d0-ff24df93d16a req-90eb07a6-eb8d-473a-adf8-d4c2c6564445 service nova] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-175abaf9-40b5-493a-b0d0-ff24df93d16a req-90eb07a6-eb8d-473a-adf8-d4c2c6564445 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-175abaf9-40b5-493a-b0d0-ff24df93d16a req-90eb07a6-eb8d-473a-adf8-d4c2c6564445 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-175abaf9-40b5-493a-b0d0-ff24df93d16a req-90eb07a6-eb8d-473a-adf8-d4c2c6564445 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] No waiting events found dispatching network-vif-unplugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:14 user nova-compute[72818]: WARNING nova.compute.manager [req-175abaf9-40b5-493a-b0d0-ff24df93d16a req-90eb07a6-eb8d-473a-adf8-d4c2c6564445 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received unexpected event network-vif-unplugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 17 21:26:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] No waiting events found dispatching network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:16 user nova-compute[72818]: WARNING nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received unexpected event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 17 21:26:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] No waiting events found dispatching network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:16 user nova-compute[72818]: WARNING nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received unexpected event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 17 21:26:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] No waiting events found dispatching network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:16 user nova-compute[72818]: WARNING nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received unexpected event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 17 21:26:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-unplugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] No waiting events found dispatching network-vif-unplugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:16 user nova-compute[72818]: WARNING nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received unexpected event network-vif-unplugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 17 21:26:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] No waiting events found dispatching network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:16 user nova-compute[72818]: WARNING nova.compute.manager [req-5849cb9d-b832-4c22-a540-4636f14e3f19 req-654e3a9e-91a8-48f2-b682-29e2a5db4931 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received unexpected event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 17 21:26:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:26:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:26:22 user nova-compute[72818]: INFO nova.compute.claims [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Claim successful on node user
Aug 17 21:26:22 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:26:22 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:26:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:26:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:26:22 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:26:22 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:26:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:26:23 user nova-compute[72818]: DEBUG nova.policy [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6cd1f219a2634975bb1362620392dc1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0b81a8a39436a9ec6e1646090f637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:26:23 user nova-compute[72818]: INFO nova.virt.block_device [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Booting with volume-backed-image 18340577-52dd-4d73-ae6b-8ba3ed9c0808 at /dev/vda
Aug 17 21:26:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:23 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Successfully created port: 87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:26:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Successfully updated port: 87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:26:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "refresh_cache-d54920e2-56cf-4c58-b66a-a454470c57d6" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:26:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquired lock "refresh_cache-d54920e2-56cf-4c58-b66a-a454470c57d6" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:26:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:26:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-5cfaca35-ac2b-4146-b29f-3c818e459478 req-b413e150-6899-436b-9cf1-b58fe3f87b4f service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-changed-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-5cfaca35-ac2b-4146-b29f-3c818e459478 req-b413e150-6899-436b-9cf1-b58fe3f87b4f service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Refreshing instance network info cache due to event network-changed-87206248-7cbe-48b7-b3f5-72ffb02ddfac. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:26:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5cfaca35-ac2b-4146-b29f-3c818e459478 req-b413e150-6899-436b-9cf1-b58fe3f87b4f service nova] Acquiring lock "refresh_cache-d54920e2-56cf-4c58-b66a-a454470c57d6" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:26:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:26:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Updating instance_info_cache with network_info: [{"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:26:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Releasing lock "refresh_cache-d54920e2-56cf-4c58-b66a-a454470c57d6" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:26:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Instance network_info: |[{"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:26:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5cfaca35-ac2b-4146-b29f-3c818e459478 req-b413e150-6899-436b-9cf1-b58fe3f87b4f service nova] Acquired lock "refresh_cache-d54920e2-56cf-4c58-b66a-a454470c57d6" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:26:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-5cfaca35-ac2b-4146-b29f-3c818e459478 req-b413e150-6899-436b-9cf1-b58fe3f87b4f service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Refreshing network info cache for port 87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:26:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-5cfaca35-ac2b-4146-b29f-3c818e459478 req-b413e150-6899-436b-9cf1-b58fe3f87b4f service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Updated VIF entry in instance network info cache for port 87206248-7cbe-48b7-b3f5-72ffb02ddfac. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:26:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-5cfaca35-ac2b-4146-b29f-3c818e459478 req-b413e150-6899-436b-9cf1-b58fe3f87b4f service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Updating instance_info_cache with network_info: [{"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:26:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5cfaca35-ac2b-4146-b29f-3c818e459478 req-b413e150-6899-436b-9cf1-b58fe3f87b4f service nova] Releasing lock "refresh_cache-d54920e2-56cf-4c58-b66a-a454470c57d6" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:26:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:26:25 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Creating image(s)
Aug 17 21:26:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "/opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "/opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.190s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.170s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk 1073741824" returned: 0 in 0.054s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307571.6944647, 8ab794f2-ef30-4524-8eea-224873d6f0b5 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:26:26 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] VM Stopped (Lifecycle Event)
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Cannot resize image /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Ensure instance console log exists: /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Start _get_guest_xml network_info=[{"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '548b2be1-be16-438f-bd04-17d4728661e9', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRFeihWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ab794f2-ef30-4524-8eea-224873d6f0b5', 'attached_at': '', 'detached_at': '', 'volume_id': '3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70', 'serial': '3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.compute.manager [None req-7ae36bde-0624-45cd-96bd-625048ef9c37 None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:26:26 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 21:26:26 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.objects.instance [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRFeihWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:26:26 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:26:26 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:26:26 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8483b5c-1bcb-49a5-895a-a46f52c14100]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:26:26 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d4d8de-b48f-45fb-830a-098510d13447]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70] added
Aug 17 21:26:26 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[303daea2-7c7b-476c-b600-4da74c06aca7]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25fbe7e-4127-4585-9daf-1f73926bbaa7]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRFeihWp {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRFeihWp" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44e1ace-4aab-49dd-878b-5a1b73b818a9]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jRFeihWp'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3295b73-68fd-41da-8fc1-2435f308ef70]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1846a390-10ae-4e79-bd90-bae5cf192080]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:26 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:26 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:26 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:26 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:26 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:26 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:26:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b7bee3-8337-41b5-869b-fe56baad484a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260]
Aug 17 21:26:27 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260] successful.
Aug 17 21:26:27 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7250856e-f54b-4c00-8e07-54888571d856]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c405f88-2e82-44f2-a613-016b3bb22c15]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:27 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:27 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:27 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:26:27 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:27 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:27 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:27 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:26:27 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[684354d1-4dc5-474b-ad3f-66f951314430]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:26:27 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRFeihWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23437383464653232', 'path': '/dev/sdd'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437383464653232', 'path': '/dev/sdd'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1842332389',display_name='tempest-ServerActionsTestOtherA-server-1272518972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1842332389',id=25,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLocLU8TRDAiLi3GdKktq0nWqdk7D1keSlsLXc1XBv8DJ5eY9kzsxQScXcrArgHMHu1A1J4D/TdCnI8XhIYNw2UvB+RykgPVyRzvdlRj00o3UKrPopaD5xejUX+15fusg==',key_name='tempest-keypair-904493785',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:24:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-igol0v2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=8ab794f2-ef30-4524-8eea-224873d6f0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:26:28 user nova-compute[72818]:   <uuid>8ab794f2-ef30-4524-8eea-224873d6f0b5</uuid>
Aug 17 21:26:28 user nova-compute[72818]:   <name>instance-00000019</name>
Aug 17 21:26:28 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:26:28 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:26:28 user nova-compute[72818]:   <metadata>
Aug 17 21:26:28 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:26:28 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:26:28 user nova-compute[72818]:       <nova:name>tempest-ServerActionsTestOtherA-server-1272518972</nova:name>
Aug 17 21:26:28 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:26:26</nova:creationTime>
Aug 17 21:26:28 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:26:28 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:26:28 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:26:28 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:26:28 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:26:28 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:26:28 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:26:28 user nova-compute[72818]:       <nova:owner>
Aug 17 21:26:28 user nova-compute[72818]:         <nova:user uuid="86cb8a969924487b8362d340d0bd31b5">tempest-ServerActionsTestOtherA-1230434837-project-member</nova:user>
Aug 17 21:26:28 user nova-compute[72818]:         <nova:project uuid="d5202a87dcf64b979cce5074783790f9">tempest-ServerActionsTestOtherA-1230434837</nova:project>
Aug 17 21:26:28 user nova-compute[72818]:       </nova:owner>
Aug 17 21:26:28 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:26:28 user nova-compute[72818]:       <nova:ports>
Aug 17 21:26:28 user nova-compute[72818]:         <nova:port uuid="9576b57c-48c9-4fe8-bfc8-17876b941e67">
Aug 17 21:26:28 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 21:26:28 user nova-compute[72818]:         </nova:port>
Aug 17 21:26:28 user nova-compute[72818]:       </nova:ports>
Aug 17 21:26:28 user nova-compute[72818]:     </nova:instance>
Aug 17 21:26:28 user nova-compute[72818]:   </metadata>
Aug 17 21:26:28 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:26:28 user nova-compute[72818]:     <system>
Aug 17 21:26:28 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:26:28 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:26:28 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:26:28 user nova-compute[72818]:       <entry name="serial">8ab794f2-ef30-4524-8eea-224873d6f0b5</entry>
Aug 17 21:26:28 user nova-compute[72818]:       <entry name="uuid">8ab794f2-ef30-4524-8eea-224873d6f0b5</entry>
Aug 17 21:26:28 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:26:28 user nova-compute[72818]:     </system>
Aug 17 21:26:28 user nova-compute[72818]:   </sysinfo>
Aug 17 21:26:28 user nova-compute[72818]:   <os>
Aug 17 21:26:28 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:26:28 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:26:28 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:26:28 user nova-compute[72818]:   </os>
Aug 17 21:26:28 user nova-compute[72818]:   <features>
Aug 17 21:26:28 user nova-compute[72818]:     <acpi/>
Aug 17 21:26:28 user nova-compute[72818]:     <apic/>
Aug 17 21:26:28 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:26:28 user nova-compute[72818]:   </features>
Aug 17 21:26:28 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:26:28 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:26:28 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:26:28 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:26:28 user nova-compute[72818]:   </clock>
Aug 17 21:26:28 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:26:28 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:26:28 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:26:28 user nova-compute[72818]:   </cpu>
Aug 17 21:26:28 user nova-compute[72818]:   <devices>
Aug 17 21:26:28 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:26:28 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:26:28 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk"/>
Aug 17 21:26:28 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:26:28 user nova-compute[72818]:     </disk>
Aug 17 21:26:28 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:26:28 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:26:28 user nova-compute[72818]:       <source dev="/dev/sdd"/>
Aug 17 21:26:28 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:26:28 user nova-compute[72818]:       <serial>3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70</serial>
Aug 17 21:26:28 user nova-compute[72818]:     </disk>
Aug 17 21:26:28 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:26:28 user nova-compute[72818]:       <mac address="fa:16:3e:61:46:e5"/>
Aug 17 21:26:28 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:26:28 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:26:28 user nova-compute[72818]:       <target dev="tap9576b57c-48"/>
Aug 17 21:26:28 user nova-compute[72818]:     </interface>
Aug 17 21:26:28 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:26:28 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/console.log" append="off"/>
Aug 17 21:26:28 user nova-compute[72818]:     </serial>
Aug 17 21:26:28 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:26:28 user nova-compute[72818]:     <video>
Aug 17 21:26:28 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:26:28 user nova-compute[72818]:     </video>
Aug 17 21:26:28 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:26:28 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:26:28 user nova-compute[72818]:     </rng>
Aug 17 21:26:28 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:26:28 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:26:28 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:26:28 user nova-compute[72818]:     </memballoon>
Aug 17 21:26:28 user nova-compute[72818]:   </devices>
Aug 17 21:26:28 user nova-compute[72818]: </domain>
Aug 17 21:26:28 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1842332389',display_name='tempest-ServerActionsTestOtherA-server-1272518972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1842332389',id=25,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLocLU8TRDAiLi3GdKktq0nWqdk7D1keSlsLXc1XBv8DJ5eY9kzsxQScXcrArgHMHu1A1J4D/TdCnI8XhIYNw2UvB+RykgPVyRzvdlRj00o3UKrPopaD5xejUX+15fusg==',key_name='tempest-keypair-904493785',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:24:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-igol0v2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=8ab794f2-ef30-4524-8eea-224873d6f0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG os_vif [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9576b57c-48, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9576b57c-48, col_values=(('external_ids', {'iface-id': '9576b57c-48c9-4fe8-bfc8-17876b941e67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:46:e5', 'vm-uuid': '8ab794f2-ef30-4524-8eea-224873d6f0b5'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:28 user nova-compute[72818]: INFO os_vif [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48')
Aug 17 21:26:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:26:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] No VIF found with MAC fa:16:3e:61:46:e5, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:26:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:29 user nova-compute[72818]: DEBUG nova.compute.manager [req-0ff5292c-f4a4-4954-8a37-e47f9b0db260 req-35af437e-8407-4f20-b763-b8c97d6ca91f service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0ff5292c-f4a4-4954-8a37-e47f9b0db260 req-35af437e-8407-4f20-b763-b8c97d6ca91f service nova] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0ff5292c-f4a4-4954-8a37-e47f9b0db260 req-35af437e-8407-4f20-b763-b8c97d6ca91f service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0ff5292c-f4a4-4954-8a37-e47f9b0db260 req-35af437e-8407-4f20-b763-b8c97d6ca91f service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:29 user nova-compute[72818]: DEBUG nova.compute.manager [req-0ff5292c-f4a4-4954-8a37-e47f9b0db260 req-35af437e-8407-4f20-b763-b8c97d6ca91f service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] No waiting events found dispatching network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:29 user nova-compute[72818]: WARNING nova.compute.manager [req-0ff5292c-f4a4-4954-8a37-e47f9b0db260 req-35af437e-8407-4f20-b763-b8c97d6ca91f service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received unexpected event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 21:26:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-5d0405ae-d0f0-4cc3-8d87-efe3e7ccf3bd req-eb5b85a5-47a0-4e77-876f-2bb45e34dfd4 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5d0405ae-d0f0-4cc3-8d87-efe3e7ccf3bd req-eb5b85a5-47a0-4e77-876f-2bb45e34dfd4 service nova] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5d0405ae-d0f0-4cc3-8d87-efe3e7ccf3bd req-eb5b85a5-47a0-4e77-876f-2bb45e34dfd4 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5d0405ae-d0f0-4cc3-8d87-efe3e7ccf3bd req-eb5b85a5-47a0-4e77-876f-2bb45e34dfd4 service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-5d0405ae-d0f0-4cc3-8d87-efe3e7ccf3bd req-eb5b85a5-47a0-4e77-876f-2bb45e34dfd4 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] No waiting events found dispatching network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:31 user nova-compute[72818]: WARNING nova.compute.manager [req-5d0405ae-d0f0-4cc3-8d87-efe3e7ccf3bd req-eb5b85a5-47a0-4e77-876f-2bb45e34dfd4 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received unexpected event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 21:26:31 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307591.9649844, 8ab794f2-ef30-4524-8eea-224873d6f0b5 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:26:31 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] VM Resumed (Lifecycle Event)
Aug 17 21:26:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:26:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:26:31 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Instance spawned successfully.
Aug 17 21:26:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:26:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:26:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:26:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:26:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:26:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:26:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:26:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:26:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:26:32 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 21:26:32 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307591.966052, 8ab794f2-ef30-4524-8eea-224873d6f0b5 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:26:32 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] VM Started (Lifecycle Event)
Aug 17 21:26:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:26:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:26:32 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 21:26:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:26:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:32 user nova-compute[72818]: DEBUG nova.objects.instance [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72818) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 21:26:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51e253d1-d2bc-410f-9da8-f3421f862aa4 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG os_brick.utils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f274f165-f6fc-4282-96d0-1bbd97420991]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc368d5-909d-4275-a8fb-85f4d94ed3c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[208913eb-3dba-4ad2-8f58-ba8c57eab8a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[84064434-110e-4663-8ed3-58f3c190d02a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:26:39 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:26:39 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec25cc0-2088-4c10-9771-9cec67d0c88d]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG os_brick.utils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:26:39 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Updating existing volume attachment record: 73a7af62-e4d8-4a84-8fe7-fa5f40060580 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:26:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "8b6e6587-fddd-45bf-b295-e7eaace49948" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:49 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:26:50 user nova-compute[72818]: INFO nova.compute.claims [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Claim successful on node user
Aug 17 21:26:50 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:26:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:26:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:50 user nova-compute[72818]: INFO nova.compute.manager [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Unshelving
Aug 17 21:26:50 user nova-compute[72818]: INFO nova.virt.block_device [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Booting with volume snapshot 5d7b45f4-d503-46e4-8e57-76655b6e6f05 at /dev/vda
Aug 17 21:26:50 user nova-compute[72818]: DEBUG nova.policy [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de902559a8794d1a8af9c0efbed4e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92abc22a192a44398dffe75ffae6d270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:26:50 user nova-compute[72818]: INFO nova.virt.block_device [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Booting with volume c4a67fd5-dd50-4a87-a413-fec308eb6f2f at /dev/vda
Aug 17 21:26:50 user nova-compute[72818]: DEBUG os_brick.utils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.091s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3619d4-d650-4209-b367-f28d6bce69be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[85462a6d-64af-42eb-85dd-f68e9c6d27f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b89184-9de1-4604-892f-26f11e30987b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b670b6-98f1-4d24-a50d-46601e37e3a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:26:50 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:26:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[21badc5e-5d48-412e-8292-d081f14ec27b]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:26:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:26:51 user nova-compute[72818]: DEBUG os_brick.utils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:26:51 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updating existing volume attachment record: 1be9ac96-80cd-4916-a137-f93b02c19b24 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:26:51 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Successfully created port: c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:26:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Successfully updated port: c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "refresh_cache-8b6e6587-fddd-45bf-b295-e7eaace49948" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquired lock "refresh_cache-8b6e6587-fddd-45bf-b295-e7eaace49948" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG nova.compute.manager [req-49c94c8c-d379-4e5d-894d-3bf2d85eb3ba req-5e8a48c5-b972-4308-ac66-16ccad1e6d2a service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Received event network-changed-c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG nova.compute.manager [req-49c94c8c-d379-4e5d-894d-3bf2d85eb3ba req-5e8a48c5-b972-4308-ac66-16ccad1e6d2a service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Refreshing instance network info cache due to event network-changed-c5fffdf3-3301-4b5b-b513-36c11c849eb4. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-49c94c8c-d379-4e5d-894d-3bf2d85eb3ba req-5e8a48c5-b972-4308-ac66-16ccad1e6d2a service nova] Acquiring lock "refresh_cache-8b6e6587-fddd-45bf-b295-e7eaace49948" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Updating instance_info_cache with network_info: [{"id": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "address": "fa:16:3e:69:a2:08", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fffdf3-33", "ovs_interfaceid": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Releasing lock "refresh_cache-8b6e6587-fddd-45bf-b295-e7eaace49948" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Instance network_info: |[{"id": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "address": "fa:16:3e:69:a2:08", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fffdf3-33", "ovs_interfaceid": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-49c94c8c-d379-4e5d-894d-3bf2d85eb3ba req-5e8a48c5-b972-4308-ac66-16ccad1e6d2a service nova] Acquired lock "refresh_cache-8b6e6587-fddd-45bf-b295-e7eaace49948" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:26:52 user nova-compute[72818]: DEBUG nova.network.neutron [req-49c94c8c-d379-4e5d-894d-3bf2d85eb3ba req-5e8a48c5-b972-4308-ac66-16ccad1e6d2a service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Refreshing network info cache for port c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:26:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:53 user nova-compute[72818]: DEBUG nova.network.neutron [req-49c94c8c-d379-4e5d-894d-3bf2d85eb3ba req-5e8a48c5-b972-4308-ac66-16ccad1e6d2a service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Updated VIF entry in instance network info cache for port c5fffdf3-3301-4b5b-b513-36c11c849eb4. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:26:53 user nova-compute[72818]: DEBUG nova.network.neutron [req-49c94c8c-d379-4e5d-894d-3bf2d85eb3ba req-5e8a48c5-b972-4308-ac66-16ccad1e6d2a service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Updating instance_info_cache with network_info: [{"id": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "address": "fa:16:3e:69:a2:08", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fffdf3-33", "ovs_interfaceid": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:26:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-49c94c8c-d379-4e5d-894d-3bf2d85eb3ba req-5e8a48c5-b972-4308-ac66-16ccad1e6d2a service nova] Releasing lock "refresh_cache-8b6e6587-fddd-45bf-b295-e7eaace49948" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:54 user nova-compute[72818]: INFO nova.compute.manager [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Terminating instance
Aug 17 21:26:54 user nova-compute[72818]: DEBUG nova.compute.manager [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG nova.compute.manager [req-13acaf9d-8e95-4c4a-80ca-39b2e23842f5 req-5a8bb944-f37b-45cf-bca1-c3c49ce6608a service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event network-vif-unplugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-13acaf9d-8e95-4c4a-80ca-39b2e23842f5 req-5a8bb944-f37b-45cf-bca1-c3c49ce6608a service nova] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-13acaf9d-8e95-4c4a-80ca-39b2e23842f5 req-5a8bb944-f37b-45cf-bca1-c3c49ce6608a service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-13acaf9d-8e95-4c4a-80ca-39b2e23842f5 req-5a8bb944-f37b-45cf-bca1-c3c49ce6608a service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG nova.compute.manager [req-13acaf9d-8e95-4c4a-80ca-39b2e23842f5 req-5a8bb944-f37b-45cf-bca1-c3c49ce6608a service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] No waiting events found dispatching network-vif-unplugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG nova.compute.manager [req-13acaf9d-8e95-4c4a-80ca-39b2e23842f5 req-5a8bb944-f37b-45cf-bca1-c3c49ce6608a service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event network-vif-unplugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:26:54 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:26:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Instance destroyed successfully.
Aug 17 21:26:55 user nova-compute[72818]: DEBUG nova.objects.instance [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lazy-loading 'resources' on Instance uuid 9f46c1c0-c2b8-40cf-991f-c99735954429 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-770936818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2060472075',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK9sJ2eq4o1JXfewQMshfkbC/kWFIvZxaJPcJLK3eMuQLLKsKNEtt9xLpxeN3txHMhagw7dYKiIeNu3aT7ClMUBqylRglK6VlcEfzYrHDU428DAM8IN/BPX4mbewJMS+Q==',key_name='tempest-keypair-741246036',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ba1c61f7c2e4fd5a5a15bf69db27050',ramdisk_id='',reservation_id='r-rmts4810',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-329717180',owner_user_name='tempest-ServerActionsV293TestJSON-329717180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a35702dbbfa4620ac760c2dedfd5582',uuid=9f46c1c0-c2b8-40cf-991f-c99735954429,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Converting VIF {"id": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "address": "fa:16:3e:c3:cc:b0", "network": {"id": "eabbbb77-3b65-4e05-b7cc-b27e472f223b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1878782390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba1c61f7c2e4fd5a5a15bf69db27050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ef7f30-63", "ovs_interfaceid": "c0ef7f30-6392-41c4-9d25-03f33cf3766a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_vif [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0ef7f30-63, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:26:55 user nova-compute[72818]: INFO os_vif [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cc:b0,bridge_name='br-int',has_traffic_filtering=True,id=c0ef7f30-6392-41c4-9d25-03f33cf3766a,network=Network(eabbbb77-3b65-4e05-b7cc-b27e472f223b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ef7f30-63')
Aug 17 21:26:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frYIbUPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:26:55 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e09ff5-c2b7-46f2-906d-30e74071ca69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[90056769-5650-4838-a526-b8e1435980de]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:55 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:55 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:55 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:26:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:26:55 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:26:55 user nova-compute[72818]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc (non-flash)
Aug 17 21:26:55 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:26:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f2853ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc'): ({'sdc'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Removing single pathed devices sdc {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c308470-c082-4d8a-b1a4-603693380ba9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0406254c-d275-477f-b64c-41f4ee0a3dcd]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Flushing IO for device /dev/sdc {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[800b8ff6-eaf3-4035-8710-ca1e9e9c3997]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f5342d-eb1e-4933-bc85-9f816f3096f4]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3a91ddc8', '/dev/disk/by-id/scsi-1SCST_BIO3a91ddc8-79a3b55f78be25a9', '/dev/disk/by-id/scsi-23739613362353566') {{(pid=83620) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2125397f-8a07-4e6a-8086-4dffe66314b3]: (4, None) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4ae2dd-c6bd-4347-874d-1116b24ffbee]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae4b570-51f0-46e2-96d0-c07df6326422]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260]
Aug 17 21:26:55 user nova-compute[72818]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc, portal: 172.16.0.220,3260] successful.
Aug 17 21:26:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ab88003-1572-4052-a202-05a85d1904fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e02193-d36b-467e-a7f8-b4124ff8e07f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] <== disconnect_volume: return (329ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:26:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Deleting instance files /opt/stack/data/nova/instances/9f46c1c0-c2b8-40cf-991f-c99735954429_del
Aug 17 21:26:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Deletion of /opt/stack/data/nova/instances/9f46c1c0-c2b8-40cf-991f-c99735954429_del complete
Aug 17 21:26:55 user nova-compute[72818]: INFO nova.compute.manager [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 17 21:26:55 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:26:55 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG os_brick.utils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[328d3795-9fa6-4046-9444-ca3addd9bae6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b022126-2097-4d7e-8530-54a7fd88c789]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d60d06-0478-449d-9ad8-e26fda840d35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a51eb96-41ee-43fa-86cb-4a5af28e1181]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:26:56 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[985b24f3-376c-4abd-a82a-d7fb346c7ec4]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG os_brick.utils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Updating existing volume attachment record: 5561dc0a-1bad-40b8-90b5-62c2c69a7143 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-c6ef51e2-4500-4300-afa5-4fe611e05bc1 req-a841f1a4-11d1-4b30-9f95-ecc1d9e3229f service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c6ef51e2-4500-4300-afa5-4fe611e05bc1 req-a841f1a4-11d1-4b30-9f95-ecc1d9e3229f service nova] Acquiring lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c6ef51e2-4500-4300-afa5-4fe611e05bc1 req-a841f1a4-11d1-4b30-9f95-ecc1d9e3229f service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c6ef51e2-4500-4300-afa5-4fe611e05bc1 req-a841f1a4-11d1-4b30-9f95-ecc1d9e3229f service nova] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-c6ef51e2-4500-4300-afa5-4fe611e05bc1 req-a841f1a4-11d1-4b30-9f95-ecc1d9e3229f service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] No waiting events found dispatching network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:26:56 user nova-compute[72818]: WARNING nova.compute.manager [req-c6ef51e2-4500-4300-afa5-4fe611e05bc1 req-a841f1a4-11d1-4b30-9f95-ecc1d9e3229f service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received unexpected event network-vif-plugged-c0ef7f30-6392-41c4-9d25-03f33cf3766a for instance with vm_state active and task_state deleting.
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:26:56 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:26:56 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Took 1.35 seconds to deallocate network for instance.
Aug 17 21:26:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:26:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:26:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:26:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:26:57 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:26:58 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Updating instance_info_cache with network_info: [{"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:26:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:26:58 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:26:58 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:26:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-02933275-25f5-4244-8f20-071ed84d2002 req-fbb283b4-2c15-468e-b91f-bd5eb9e0c245 service nova] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Received event network-vif-deleted-c0ef7f30-6392-41c4-9d25-03f33cf3766a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:26:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:27:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:27:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:01 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:27:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:01 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:02 user nova-compute[72818]: INFO nova.compute.manager [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Took 5.81 seconds to detach 1 volumes for instance.
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Deleting volume: 1ab88003-1572-4052-a202-05a85d1904fc {{(pid=72818) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:27:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Creating image(s)
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Ensure instance console log exists: /opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Start _get_guest_xml network_info=[{"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '73a7af62-e4d8-4a84-8fe7-fa5f40060580', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIDTCLwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd54920e2-56cf-4c58-b66a-a454470c57d6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea63b9f0-bd73-47dd-8514-101d77b604a6', 'serial': 'ea63b9f0-bd73-47dd-8514-101d77b604a6'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:02 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:27:02 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:27:02 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIDTCLwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:27:03 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:27:03 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:27:03 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb63a37-8a5f-40a8-9dd1-faf39c4665b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:27:03 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b455dee-8a0a-495d-99bd-d031f9387bf6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6] added
Aug 17 21:27:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e8e95a-2c1a-4114-a8ca-4c44964debf0]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d3239-dd4e-4fe9-a81e-5e1d683952df]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIDTCLwW {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIDTCLwW" returned: 0 in 0.032s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[189e2797-78c5-4439-ac6b-ee425a8f4d8e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NIDTCLwW'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc86e7c-b905-4535-8ac1-3fc17f75282b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdf8879-470b-469b-b91d-ca089b93541c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:03 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:27:03 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:03 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:27:03 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[64be82ea-ff8c-4266-a432-abeadd5832ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6, portal: 172.16.0.220,3260]
Aug 17 21:27:03 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6, portal: 172.16.0.220,3260] successful.
Aug 17 21:27:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bbfdba-bb22-4e63-b8d8-6f365ad74c15]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d7b0a5-cd5c-42b9-9a26-997105a05f25]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:03 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:27:03 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:03 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:27:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:03 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:27:03 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:03 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:27:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.449s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7764f0e8-fe56-4838-97e5-724adcfb6f4c]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIDTCLwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.579s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.227s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lazy-loading 'pci_requests' on Instance uuid 92f865e1-d261-47e3-a64d-dc7bc6e7a93f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lazy-loading 'numa_topology' on Instance uuid 92f865e1-d261-47e3-a64d-dc7bc6e7a93f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:27:03 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Deleted allocations for instance 9f46c1c0-c2b8-40cf-991f-c99735954429
Aug 17 21:27:03 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:27:03 user nova-compute[72818]: INFO nova.compute.claims [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Claim successful on node user
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-64b346be-fe56-4a21-adbd-2f7099268c84 tempest-ServerActionsV293TestJSON-329717180 tempest-ServerActionsV293TestJSON-329717180-project-member] Lock "9f46c1c0-c2b8-40cf-991f-c99735954429" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.349s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:04 user nova-compute[72818]: INFO nova.network.neutron [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updating port 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:04 user nova-compute[72818]: INFO nova.compute.manager [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Terminating instance
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.511s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] <== connect_volume: return (1513ms) {'type': 'block', 'scsi_wwn': '26339636632643065', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339636632643065', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-108339640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-108339640',id=26,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-7pe9h1h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:26:23Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=d54920e2-56cf-4c58-b66a-a454470c57d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=87206248-7cbe-48b7-b3f5-72ffb02ddfac,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87206248-7c') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.objects.instance [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'pci_devices' on Instance uuid d54920e2-56cf-4c58-b66a-a454470c57d6 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:27:04 user nova-compute[72818]:   <uuid>d54920e2-56cf-4c58-b66a-a454470c57d6</uuid>
Aug 17 21:27:04 user nova-compute[72818]:   <name>instance-0000001a</name>
Aug 17 21:27:04 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:27:04 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:27:04 user nova-compute[72818]:   <metadata>
Aug 17 21:27:04 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:27:04 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:27:04 user nova-compute[72818]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-108339640</nova:name>
Aug 17 21:27:04 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:27:02</nova:creationTime>
Aug 17 21:27:04 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:27:04 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:27:04 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:27:04 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:27:04 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:27:04 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:27:04 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:27:04 user nova-compute[72818]:       <nova:owner>
Aug 17 21:27:04 user nova-compute[72818]:         <nova:user uuid="6cd1f219a2634975bb1362620392dc1a">tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member</nova:user>
Aug 17 21:27:04 user nova-compute[72818]:         <nova:project uuid="dda0b81a8a39436a9ec6e1646090f637">tempest-ServerBootFromVolumeStableRescueTest-1074783662</nova:project>
Aug 17 21:27:04 user nova-compute[72818]:       </nova:owner>
Aug 17 21:27:04 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:27:04 user nova-compute[72818]:       <nova:ports>
Aug 17 21:27:04 user nova-compute[72818]:         <nova:port uuid="87206248-7cbe-48b7-b3f5-72ffb02ddfac">
Aug 17 21:27:04 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 21:27:04 user nova-compute[72818]:         </nova:port>
Aug 17 21:27:04 user nova-compute[72818]:       </nova:ports>
Aug 17 21:27:04 user nova-compute[72818]:     </nova:instance>
Aug 17 21:27:04 user nova-compute[72818]:   </metadata>
Aug 17 21:27:04 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:27:04 user nova-compute[72818]:     <system>
Aug 17 21:27:04 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:27:04 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:27:04 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:27:04 user nova-compute[72818]:       <entry name="serial">d54920e2-56cf-4c58-b66a-a454470c57d6</entry>
Aug 17 21:27:04 user nova-compute[72818]:       <entry name="uuid">d54920e2-56cf-4c58-b66a-a454470c57d6</entry>
Aug 17 21:27:04 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:27:04 user nova-compute[72818]:     </system>
Aug 17 21:27:04 user nova-compute[72818]:   </sysinfo>
Aug 17 21:27:04 user nova-compute[72818]:   <os>
Aug 17 21:27:04 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:27:04 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:27:04 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:27:04 user nova-compute[72818]:   </os>
Aug 17 21:27:04 user nova-compute[72818]:   <features>
Aug 17 21:27:04 user nova-compute[72818]:     <acpi/>
Aug 17 21:27:04 user nova-compute[72818]:     <apic/>
Aug 17 21:27:04 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:27:04 user nova-compute[72818]:   </features>
Aug 17 21:27:04 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:27:04 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:27:04 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:27:04 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:27:04 user nova-compute[72818]:   </clock>
Aug 17 21:27:04 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:27:04 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:27:04 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:27:04 user nova-compute[72818]:   </cpu>
Aug 17 21:27:04 user nova-compute[72818]:   <devices>
Aug 17 21:27:04 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:27:04 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:27:04 user nova-compute[72818]:       <source dev="/dev/sdc"/>
Aug 17 21:27:04 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:27:04 user nova-compute[72818]:       <serial>ea63b9f0-bd73-47dd-8514-101d77b604a6</serial>
Aug 17 21:27:04 user nova-compute[72818]:     </disk>
Aug 17 21:27:04 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:27:04 user nova-compute[72818]:       <mac address="fa:16:3e:4f:f9:56"/>
Aug 17 21:27:04 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:27:04 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:27:04 user nova-compute[72818]:       <target dev="tap87206248-7c"/>
Aug 17 21:27:04 user nova-compute[72818]:     </interface>
Aug 17 21:27:04 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:27:04 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/console.log" append="off"/>
Aug 17 21:27:04 user nova-compute[72818]:     </serial>
Aug 17 21:27:04 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:27:04 user nova-compute[72818]:     <video>
Aug 17 21:27:04 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:27:04 user nova-compute[72818]:     </video>
Aug 17 21:27:04 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:27:04 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:27:04 user nova-compute[72818]:     </rng>
Aug 17 21:27:04 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:27:04 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:27:04 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:27:04 user nova-compute[72818]:     </memballoon>
Aug 17 21:27:04 user nova-compute[72818]:   </devices>
Aug 17 21:27:04 user nova-compute[72818]: </domain>
Aug 17 21:27:04 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-108339640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-108339640',id=26,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-7pe9h1h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:26:23Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=d54920e2-56cf-4c58-b66a-a454470c57d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=87206248-7cbe-48b7-b3f5-72ffb02ddfac,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87206248-7c') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG os_vif [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=87206248-7cbe-48b7-b3f5-72ffb02ddfac,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87206248-7c') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87206248-7c, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87206248-7c, col_values=(('external_ids', {'iface-id': '87206248-7cbe-48b7-b3f5-72ffb02ddfac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:f9:56', 'vm-uuid': 'd54920e2-56cf-4c58-b66a-a454470c57d6'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:04 user nova-compute[72818]: INFO os_vif [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=87206248-7cbe-48b7-b3f5-72ffb02ddfac,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87206248-7c')
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No VIF found with MAC fa:16:3e:4f:f9:56, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-a8544a61-2383-4fa1-a34c-2a055e2166fa req-98bdadc2-80cc-40b7-993b-00cec0eb4bf9 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-unplugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a8544a61-2383-4fa1-a34c-2a055e2166fa req-98bdadc2-80cc-40b7-993b-00cec0eb4bf9 service nova] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a8544a61-2383-4fa1-a34c-2a055e2166fa req-98bdadc2-80cc-40b7-993b-00cec0eb4bf9 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a8544a61-2383-4fa1-a34c-2a055e2166fa req-98bdadc2-80cc-40b7-993b-00cec0eb4bf9 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-a8544a61-2383-4fa1-a34c-2a055e2166fa req-98bdadc2-80cc-40b7-993b-00cec0eb4bf9 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] No waiting events found dispatching network-vif-unplugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-a8544a61-2383-4fa1-a34c-2a055e2166fa req-98bdadc2-80cc-40b7-993b-00cec0eb4bf9 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-unplugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquired lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG nova.network.neutron [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-feaecebb-2ecd-417f-af56-44facb1fee4d req-b0bfd767-266b-4fdd-b67b-060f00f274e7 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-changed-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-feaecebb-2ecd-417f-af56-44facb1fee4d req-b0bfd767-266b-4fdd-b67b-060f00f274e7 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Refreshing instance network info cache due to event network-changed-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-feaecebb-2ecd-417f-af56-44facb1fee4d req-b0bfd767-266b-4fdd-b67b-060f00f274e7 service nova] Acquiring lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:27:05 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Instance destroyed successfully.
Aug 17 21:27:05 user nova-compute[72818]: DEBUG nova.objects.instance [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lazy-loading 'resources' on Instance uuid e8b5ccab-5dff-4458-a799-8c8528a032b1 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949986485',display_name='tempest-ServerActionsTestOtherB-server-949986485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949986485',id=13,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRc64wH9u6dm3xi4kk/wBQ/vGvOzR5k+mWwsr3HttVU/OU3wMLvrRNNKLA460//NVqERVsDyz6LYVlThM/1o9Ih8+/vljt/Rg70GDESbu8oCMaWXuSfr3pfnG0YVMizwg==',key_name='tempest-keypair-722674119',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a18e542cdfb74711b0decf0c1f008e0b',ramdisk_id='',reservation_id='r-jwckp96f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1842371167',owner_user_name='tempest-ServerActionsTestOtherB-1842371167-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:24:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e0d4b90694b09a71fc7790bb532df',uuid=e8b5ccab-5dff-4458-a799-8c8528a032b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converting VIF {"id": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "address": "fa:16:3e:ba:1c:1e", "network": {"id": "44ecf01a-7dac-4b49-bcf6-bae00b0a4950", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-558718957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e542cdfb74711b0decf0c1f008e0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25efe920-cf", "ovs_interfaceid": "25efe920-cfdf-428d-86ee-0f9b8f301e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG os_vif [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25efe920-cf, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:05 user nova-compute[72818]: INFO os_vif [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1c:1e,bridge_name='br-int',has_traffic_filtering=True,id=25efe920-cfdf-428d-86ee-0f9b8f301e11,network=Network(44ecf01a-7dac-4b49-bcf6-bae00b0a4950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25efe920-cf')
Aug 17 21:27:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTbWkAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:27:05 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:27:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ccc5e2-b74f-4b9f-bf79-b0fcf328cfb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dadc87b-771d-4c6b-ac19-684213c77d5c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:06 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:27:06 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:06 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:27:06 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:06 user nova-compute[72818]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b (non-flash)
Aug 17 21:27:06 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:06 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:27:06 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04d7ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:27:06 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7576MB free_disk=25.324668884277344GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7452340-f858-4a5f-854f-209a4edcdaf2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff98d4a-6346-406e-a661-6a9ecb8ef597]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fb116e-e341-498b-b941-c0a7d33761d1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ed7fbd-4f84-4789-a93d-af9a98fdd4b1]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebf9783-bc57-4fbe-b455-e2226da1e024]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 774642dc-1888-4f4e-9485-b6dfe7ad6a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e8b5ccab-5dff-4458-a799-8c8528a032b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 6c46354a-2316-4703-b7fb-431fa37df1ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance d54920e2-56cf-4c58-b66a-a454470c57d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8b6e6587-fddd-45bf-b295-e7eaace49948 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (d156e3af-684d-47e1-a951-585f9c95fa46): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a16efde-2b3b-4f3a-8fab-be0dba7c37cb]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260]
Aug 17 21:27:06 user nova-compute[72818]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b, portal: 172.16.0.220,3260] successful.
Aug 17 21:27:06 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943bedfa-18f9-40fc-a827-0e911837568b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c28f79-e957-4c7f-bf7f-726725e1e96a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.777s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] <== disconnect_volume: return (780ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:27:06 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Deleting instance files /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1_del
Aug 17 21:27:06 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Deletion of /opt/stack/data/nova/instances/e8b5ccab-5dff-4458-a799-8c8528a032b1_del complete
Aug 17 21:27:06 user nova-compute[72818]: INFO nova.compute.manager [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Took 2.26 seconds to destroy the instance on the hypervisor.
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.network.neutron [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updating instance_info_cache with network_info: [{"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Releasing lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:27:06 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Creating image(s)
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Ensure instance console log exists: /opt/stack/data/nova/instances/92f865e1-d261-47e3-a64d-dc7bc6e7a93f/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Start _get_guest_xml network_info=[{"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '1be9ac96-80cd-4916-a137-f93b02c19b24', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZVeHRuyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '92f865e1-d261-47e3-a64d-dc7bc6e7a93f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4a67fd5-dd50-4a87-a413-fec308eb6f2f', 'serial': 'c4a67fd5-dd50-4a87-a413-fec308eb6f2f'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-feaecebb-2ecd-417f-af56-44facb1fee4d req-b0bfd767-266b-4fdd-b67b-060f00f274e7 service nova] Acquired lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.network.neutron [req-feaecebb-2ecd-417f-af56-44facb1fee4d req-b0bfd767-266b-4fdd-b67b-060f00f274e7 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Refreshing network info cache for port 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:27:06 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:27:06 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.objects.instance [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lazy-loading 'vcpu_model' on Instance uuid 92f865e1-d261-47e3-a64d-dc7bc6e7a93f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZVeHRuyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:27:06 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:27:06 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:27:06 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:27:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4afbe2-fd66-423c-83a6-bc633af2c08c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:27:06 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad90f8df-f2b1-4183-a02f-4dbe74d2225b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f] added
Aug 17 21:27:06 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98d1d40-5e71-4271-a0e3-b9c589ae217f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd3a2d0-cc94-4154-931b-e7bb3d9e8f1c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZVeHRuyD {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZVeHRuyD" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4ab441-57ec-46c3-b974-164204dc3d8d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZVeHRuyD'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c7736-c08f-4fa8-b0a4-04be61198bbe]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-dc6df618-f326-4c1d-96b5-5c9e3959600b req-f816f571-204b-4987-9f30-13b6f9f947a6 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-dc6df618-f326-4c1d-96b5-5c9e3959600b req-f816f571-204b-4987-9f30-13b6f9f947a6 service nova] Acquiring lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-dc6df618-f326-4c1d-96b5-5c9e3959600b req-f816f571-204b-4987-9f30-13b6f9f947a6 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-dc6df618-f326-4c1d-96b5-5c9e3959600b req-f816f571-204b-4987-9f30-13b6f9f947a6 service nova] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-dc6df618-f326-4c1d-96b5-5c9e3959600b req-f816f571-204b-4987-9f30-13b6f9f947a6 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] No waiting events found dispatching network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:27:07 user nova-compute[72818]: WARNING nova.compute.manager [req-dc6df618-f326-4c1d-96b5-5c9e3959600b req-f816f571-204b-4987-9f30-13b6f9f947a6 service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received unexpected event network-vif-plugged-25efe920-cfdf-428d-86ee-0f9b8f301e11 for instance with vm_state active and task_state deleting.
Aug 17 21:27:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-dc6df618-f326-4c1d-96b5-5c9e3959600b req-f816f571-204b-4987-9f30-13b6f9f947a6 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-dc6df618-f326-4c1d-96b5-5c9e3959600b req-f816f571-204b-4987-9f30-13b6f9f947a6 service nova] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-dc6df618-f326-4c1d-96b5-5c9e3959600b req-f816f571-204b-4987-9f30-13b6f9f947a6 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-dc6df618-f326-4c1d-96b5-5c9e3959600b req-f816f571-204b-4987-9f30-13b6f9f947a6 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-dc6df618-f326-4c1d-96b5-5c9e3959600b req-f816f571-204b-4987-9f30-13b6f9f947a6 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] No waiting events found dispatching network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:27:07 user nova-compute[72818]: WARNING nova.compute.manager [req-dc6df618-f326-4c1d-96b5-5c9e3959600b req-f816f571-204b-4987-9f30-13b6f9f947a6 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received unexpected event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac for instance with vm_state building and task_state spawning.
Aug 17 21:27:07 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e42a9a-9135-4204-8a07-de68b988c1cf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:07 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:07 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:27:07 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:07 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:07 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:27:07 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.767s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8671c67-c4ec-47fc-af1d-61ff7a99b5db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260]
Aug 17 21:27:07 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260] successful.
Aug 17 21:27:07 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5cdb3d-7459-49e1-b5f4-74242d7f850f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2eedc8a-e8fa-41af-97bf-6001a8a3661b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:07 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:07 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:27:07 user nova-compute[72818]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:27:07 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:07 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:07 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:27:07 user nova-compute[72818]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:27:07 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c2de8f-7bd9-43fd-bcd0-7bbd885e17b7]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG nova.network.neutron [req-feaecebb-2ecd-417f-af56-44facb1fee4d req-b0bfd767-266b-4fdd-b67b-060f00f274e7 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updated VIF entry in instance network info cache for port 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG nova.network.neutron [req-feaecebb-2ecd-417f-af56-44facb1fee4d req-b0bfd767-266b-4fdd-b67b-060f00f274e7 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updating instance_info_cache with network_info: [{"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-feaecebb-2ecd-417f-af56-44facb1fee4d req-b0bfd767-266b-4fdd-b67b-060f00f274e7 service nova] Releasing lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:27:07 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:27:07 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Took 1.06 seconds to deallocate network for instance.
Aug 17 21:27:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-44fe3ce0-63a2-483c-855c-faba5927abfb req-ca137004-9425-425a-aa67-a485e7072f4a service nova] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Received event network-vif-deleted-25efe920-cfdf-428d-86ee-0f9b8f301e11 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZVeHRuyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23361373536306530', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361373536306530', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-722415076',display_name='tempest-TestShelveInstance-server-722415076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-722415076',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1267606421',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:23:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='30ddbaf2a03d4f14b7b7ca0096d05c4a',ramdisk_id='',reservation_id='r-k1p3u19l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-15245591',owner_user_name='tempest-TestShelveInstance-15245591-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:26:51Z,user_data=None,user_id='859bd4e053cd4fc6b7e6633afb107758',uuid=92f865e1-d261-47e3-a64d-dc7bc6e7a93f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Converting VIF {"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.objects.instance [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lazy-loading 'pci_devices' on Instance uuid 92f865e1-d261-47e3-a64d-dc7bc6e7a93f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:27:08 user nova-compute[72818]:   <uuid>92f865e1-d261-47e3-a64d-dc7bc6e7a93f</uuid>
Aug 17 21:27:08 user nova-compute[72818]:   <name>instance-00000016</name>
Aug 17 21:27:08 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:27:08 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:27:08 user nova-compute[72818]:   <metadata>
Aug 17 21:27:08 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:27:08 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:27:08 user nova-compute[72818]:       <nova:name>tempest-TestShelveInstance-server-722415076</nova:name>
Aug 17 21:27:08 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:27:06</nova:creationTime>
Aug 17 21:27:08 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:27:08 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:27:08 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:27:08 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:27:08 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:27:08 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:27:08 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:27:08 user nova-compute[72818]:       <nova:owner>
Aug 17 21:27:08 user nova-compute[72818]:         <nova:user uuid="859bd4e053cd4fc6b7e6633afb107758">tempest-TestShelveInstance-15245591-project-member</nova:user>
Aug 17 21:27:08 user nova-compute[72818]:         <nova:project uuid="30ddbaf2a03d4f14b7b7ca0096d05c4a">tempest-TestShelveInstance-15245591</nova:project>
Aug 17 21:27:08 user nova-compute[72818]:       </nova:owner>
Aug 17 21:27:08 user nova-compute[72818]:       <nova:ports>
Aug 17 21:27:08 user nova-compute[72818]:         <nova:port uuid="11b6e8dd-b7be-4017-bf4a-1baf62da4e5a">
Aug 17 21:27:08 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 21:27:08 user nova-compute[72818]:         </nova:port>
Aug 17 21:27:08 user nova-compute[72818]:       </nova:ports>
Aug 17 21:27:08 user nova-compute[72818]:     </nova:instance>
Aug 17 21:27:08 user nova-compute[72818]:   </metadata>
Aug 17 21:27:08 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:27:08 user nova-compute[72818]:     <system>
Aug 17 21:27:08 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:27:08 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:27:08 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:27:08 user nova-compute[72818]:       <entry name="serial">92f865e1-d261-47e3-a64d-dc7bc6e7a93f</entry>
Aug 17 21:27:08 user nova-compute[72818]:       <entry name="uuid">92f865e1-d261-47e3-a64d-dc7bc6e7a93f</entry>
Aug 17 21:27:08 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:27:08 user nova-compute[72818]:     </system>
Aug 17 21:27:08 user nova-compute[72818]:   </sysinfo>
Aug 17 21:27:08 user nova-compute[72818]:   <os>
Aug 17 21:27:08 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:27:08 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:27:08 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:27:08 user nova-compute[72818]:   </os>
Aug 17 21:27:08 user nova-compute[72818]:   <features>
Aug 17 21:27:08 user nova-compute[72818]:     <acpi/>
Aug 17 21:27:08 user nova-compute[72818]:     <apic/>
Aug 17 21:27:08 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:27:08 user nova-compute[72818]:   </features>
Aug 17 21:27:08 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:27:08 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:27:08 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:27:08 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:27:08 user nova-compute[72818]:   </clock>
Aug 17 21:27:08 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:27:08 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:27:08 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:27:08 user nova-compute[72818]:   </cpu>
Aug 17 21:27:08 user nova-compute[72818]:   <devices>
Aug 17 21:27:08 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:27:08 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:27:08 user nova-compute[72818]:       <source dev="/dev/sdb"/>
Aug 17 21:27:08 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:27:08 user nova-compute[72818]:       <serial>c4a67fd5-dd50-4a87-a413-fec308eb6f2f</serial>
Aug 17 21:27:08 user nova-compute[72818]:     </disk>
Aug 17 21:27:08 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:27:08 user nova-compute[72818]:       <mac address="fa:16:3e:fb:b2:1a"/>
Aug 17 21:27:08 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:27:08 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:27:08 user nova-compute[72818]:       <target dev="tap11b6e8dd-b7"/>
Aug 17 21:27:08 user nova-compute[72818]:     </interface>
Aug 17 21:27:08 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:27:08 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/92f865e1-d261-47e3-a64d-dc7bc6e7a93f/console.log" append="off"/>
Aug 17 21:27:08 user nova-compute[72818]:     </serial>
Aug 17 21:27:08 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:27:08 user nova-compute[72818]:     <video>
Aug 17 21:27:08 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:27:08 user nova-compute[72818]:     </video>
Aug 17 21:27:08 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:27:08 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:27:08 user nova-compute[72818]:     </rng>
Aug 17 21:27:08 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:27:08 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:27:08 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:27:08 user nova-compute[72818]:     </memballoon>
Aug 17 21:27:08 user nova-compute[72818]:   </devices>
Aug 17 21:27:08 user nova-compute[72818]: </domain>
Aug 17 21:27:08 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-722415076',display_name='tempest-TestShelveInstance-server-722415076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-722415076',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1267606421',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:23:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='30ddbaf2a03d4f14b7b7ca0096d05c4a',ramdisk_id='',reservation_id='r-k1p3u19l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-15245591',owner_user_name='tempest-TestShelveInstance-15245591-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:26:51Z,user_data=None,user_id='859bd4e053cd4fc6b7e6633afb107758',uuid=92f865e1-d261-47e3-a64d-dc7bc6e7a93f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Converting VIF {"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG os_vif [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11b6e8dd-b7, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11b6e8dd-b7, col_values=(('external_ids', {'iface-id': '11b6e8dd-b7be-4017-bf4a-1baf62da4e5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:b2:1a', 'vm-uuid': '92f865e1-d261-47e3-a64d-dc7bc6e7a93f'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:08 user nova-compute[72818]: INFO os_vif [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7')
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] No VIF found with MAC fa:16:3e:fb:b2:1a, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:27:08 user nova-compute[72818]: INFO nova.compute.manager [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Took 0.86 seconds to detach 1 volumes for instance.
Aug 17 21:27:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307628.7843904, d54920e2-56cf-4c58-b66a-a454470c57d6 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:27:08 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] VM Resumed (Lifecycle Event)
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:27:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:27:09 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Instance spawned successfully.
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-19a528a7-f939-4d06-b8a2-f5c94cfdfdb3 req-08906e4d-da8f-4b4e-98c3-c1ef8c0c1ca7 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-19a528a7-f939-4d06-b8a2-f5c94cfdfdb3 req-08906e4d-da8f-4b4e-98c3-c1ef8c0c1ca7 service nova] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-19a528a7-f939-4d06-b8a2-f5c94cfdfdb3 req-08906e4d-da8f-4b4e-98c3-c1ef8c0c1ca7 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-19a528a7-f939-4d06-b8a2-f5c94cfdfdb3 req-08906e4d-da8f-4b4e-98c3-c1ef8c0c1ca7 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-19a528a7-f939-4d06-b8a2-f5c94cfdfdb3 req-08906e4d-da8f-4b4e-98c3-c1ef8c0c1ca7 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] No waiting events found dispatching network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:27:09 user nova-compute[72818]: WARNING nova.compute.manager [req-19a528a7-f939-4d06-b8a2-f5c94cfdfdb3 req-08906e4d-da8f-4b4e-98c3-c1ef8c0c1ca7 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received unexpected event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac for instance with vm_state building and task_state spawning.
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:27:09 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307628.8466973, d54920e2-56cf-4c58-b66a-a454470c57d6 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:27:09 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] VM Started (Lifecycle Event)
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:27:09 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:27:09 user nova-compute[72818]: INFO nova.compute.manager [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:27:09 user nova-compute[72818]: INFO nova.compute.manager [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Took 47.05 seconds to build instance.
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:27:09 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Creating image(s)
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Ensure instance console log exists: /opt/stack/data/nova/instances/8b6e6587-fddd-45bf-b295-e7eaace49948/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Start _get_guest_xml network_info=[{"id": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "address": "fa:16:3e:69:a2:08", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fffdf3-33", "ovs_interfaceid": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '5561dc0a-1bad-40b8-90b5-62c2c69a7143', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEGZvmFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8b6e6587-fddd-45bf-b295-e7eaace49948', 'attached_at': '', 'detached_at': '', 'volume_id': 'e33f91eb-8139-4b53-a459-6fc1b78652a1', 'serial': 'e33f91eb-8139-4b53-a459-6fc1b78652a1'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3bbf88eb-2190-4791-86e0-10eac3527765 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.168s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:27:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.687s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEGZvmFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:27:09 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:27:09 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:27:09 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:27:09 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Deleted allocations for instance e8b5ccab-5dff-4458-a799-8c8528a032b1
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61a30d3-4559-480b-bb51-e8a224a0203e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:27:09 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d40be2c-8961-4691-b1a3-20f28cc75071]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1] added
Aug 17 21:27:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbf57a8-3d50-49ce-a0fe-826a90e67f66]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-54b9d893-e8e7-4894-80a8-04c45dfc350f tempest-ServerActionsTestOtherB-1842371167 tempest-ServerActionsTestOtherB-1842371167-project-member] Lock "e8b5ccab-5dff-4458-a799-8c8528a032b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.084s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d5c061-66d1-48fe-8946-454fa7457450]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qEGZvmFY {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qEGZvmFY" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d57495-4012-498c-8015-0af61491d57b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qEGZvmFY'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d755c69a-0262-4e80-8552-81dc2f79d7a5]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aba87c-0223-4395-b549-8c996dba4e64]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:27:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:27:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[69231a68-492a-4e88-aba5-4c557123f324]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1, portal: 172.16.0.220,3260]
Aug 17 21:27:09 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1, portal: 172.16.0.220,3260] successful.
Aug 17 21:27:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4073e599-19dd-41d5-89fb-2a3ccd3d06dd]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[06616b4f-102e-42a0-a476-58f0bfe06c88]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 (non-flash)
Aug 17 21:27:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:27:09 user nova-compute[72818]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 (non-flash)
Aug 17 21:27:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dee6109-50e6-4f20-9c9e-03e4086a13fb]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEGZvmFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307615.1111975, 9f46c1c0-c2b8-40cf-991f-c99735954429 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:27:10 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] VM Stopped (Lifecycle Event)
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-1076f5d3-09fd-4139-b00e-51d21ebbf486 None None] [instance: 9f46c1c0-c2b8-40cf-991f-c99735954429] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-815e4099-3f43-45b2-9a57-0234cd5660fe req-5e4210fa-35d3-4f91-a726-df5fb5ae24cc service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-815e4099-3f43-45b2-9a57-0234cd5660fe req-5e4210fa-35d3-4f91-a726-df5fb5ae24cc service nova] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-815e4099-3f43-45b2-9a57-0234cd5660fe req-5e4210fa-35d3-4f91-a726-df5fb5ae24cc service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-815e4099-3f43-45b2-9a57-0234cd5660fe req-5e4210fa-35d3-4f91-a726-df5fb5ae24cc service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-815e4099-3f43-45b2-9a57-0234cd5660fe req-5e4210fa-35d3-4f91-a726-df5fb5ae24cc service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] No waiting events found dispatching network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:27:10 user nova-compute[72818]: WARNING nova.compute.manager [req-815e4099-3f43-45b2-9a57-0234cd5660fe req-5e4210fa-35d3-4f91-a726-df5fb5ae24cc service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received unexpected event network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23439303766333331', 'path': '/dev/sde'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439303766333331', 'path': '/dev/sde'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1463889647',display_name='tempest-TestVolumeBootPattern-server-1463889647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1463889647',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-jwy0r6x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:26:51Z,user_data=None,user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=8b6e6587-fddd-45bf-b295-e7eaace49948,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "address": "fa:16:3e:69:a2:08", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fffdf3-33", "ovs_interfaceid": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "address": "fa:16:3e:69:a2:08", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fffdf3-33", "ovs_interfaceid": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=c5fffdf3-3301-4b5b-b513-36c11c849eb4,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fffdf3-33') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.objects.instance [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b6e6587-fddd-45bf-b295-e7eaace49948 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:27:10 user nova-compute[72818]:   <uuid>8b6e6587-fddd-45bf-b295-e7eaace49948</uuid>
Aug 17 21:27:10 user nova-compute[72818]:   <name>instance-0000001b</name>
Aug 17 21:27:10 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:27:10 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:27:10 user nova-compute[72818]:   <metadata>
Aug 17 21:27:10 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:27:10 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:27:10 user nova-compute[72818]:       <nova:name>tempest-TestVolumeBootPattern-server-1463889647</nova:name>
Aug 17 21:27:10 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:27:09</nova:creationTime>
Aug 17 21:27:10 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:27:10 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:27:10 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:27:10 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:27:10 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:27:10 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:27:10 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:27:10 user nova-compute[72818]:       <nova:owner>
Aug 17 21:27:10 user nova-compute[72818]:         <nova:user uuid="de902559a8794d1a8af9c0efbed4e38a">tempest-TestVolumeBootPattern-973058317-project-member</nova:user>
Aug 17 21:27:10 user nova-compute[72818]:         <nova:project uuid="92abc22a192a44398dffe75ffae6d270">tempest-TestVolumeBootPattern-973058317</nova:project>
Aug 17 21:27:10 user nova-compute[72818]:       </nova:owner>
Aug 17 21:27:10 user nova-compute[72818]:       <nova:ports>
Aug 17 21:27:10 user nova-compute[72818]:         <nova:port uuid="c5fffdf3-3301-4b5b-b513-36c11c849eb4">
Aug 17 21:27:10 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 21:27:10 user nova-compute[72818]:         </nova:port>
Aug 17 21:27:10 user nova-compute[72818]:       </nova:ports>
Aug 17 21:27:10 user nova-compute[72818]:     </nova:instance>
Aug 17 21:27:10 user nova-compute[72818]:   </metadata>
Aug 17 21:27:10 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:27:10 user nova-compute[72818]:     <system>
Aug 17 21:27:10 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:27:10 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:27:10 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:27:10 user nova-compute[72818]:       <entry name="serial">8b6e6587-fddd-45bf-b295-e7eaace49948</entry>
Aug 17 21:27:10 user nova-compute[72818]:       <entry name="uuid">8b6e6587-fddd-45bf-b295-e7eaace49948</entry>
Aug 17 21:27:10 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:27:10 user nova-compute[72818]:     </system>
Aug 17 21:27:10 user nova-compute[72818]:   </sysinfo>
Aug 17 21:27:10 user nova-compute[72818]:   <os>
Aug 17 21:27:10 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:27:10 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:27:10 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:27:10 user nova-compute[72818]:   </os>
Aug 17 21:27:10 user nova-compute[72818]:   <features>
Aug 17 21:27:10 user nova-compute[72818]:     <acpi/>
Aug 17 21:27:10 user nova-compute[72818]:     <apic/>
Aug 17 21:27:10 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:27:10 user nova-compute[72818]:   </features>
Aug 17 21:27:10 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:27:10 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:27:10 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:27:10 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:27:10 user nova-compute[72818]:   </clock>
Aug 17 21:27:10 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:27:10 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:27:10 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:27:10 user nova-compute[72818]:   </cpu>
Aug 17 21:27:10 user nova-compute[72818]:   <devices>
Aug 17 21:27:10 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:27:10 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:27:10 user nova-compute[72818]:       <source dev="/dev/sde"/>
Aug 17 21:27:10 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:27:10 user nova-compute[72818]:       <serial>e33f91eb-8139-4b53-a459-6fc1b78652a1</serial>
Aug 17 21:27:10 user nova-compute[72818]:     </disk>
Aug 17 21:27:10 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:27:10 user nova-compute[72818]:       <mac address="fa:16:3e:69:a2:08"/>
Aug 17 21:27:10 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:27:10 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:27:10 user nova-compute[72818]:       <target dev="tapc5fffdf3-33"/>
Aug 17 21:27:10 user nova-compute[72818]:     </interface>
Aug 17 21:27:10 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:27:10 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/8b6e6587-fddd-45bf-b295-e7eaace49948/console.log" append="off"/>
Aug 17 21:27:10 user nova-compute[72818]:     </serial>
Aug 17 21:27:10 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:27:10 user nova-compute[72818]:     <video>
Aug 17 21:27:10 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:27:10 user nova-compute[72818]:     </video>
Aug 17 21:27:10 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:27:10 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:27:10 user nova-compute[72818]:     </rng>
Aug 17 21:27:10 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:27:10 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:27:10 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:27:10 user nova-compute[72818]:     </memballoon>
Aug 17 21:27:10 user nova-compute[72818]:   </devices>
Aug 17 21:27:10 user nova-compute[72818]: </domain>
Aug 17 21:27:10 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1463889647',display_name='tempest-TestVolumeBootPattern-server-1463889647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1463889647',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-jwy0r6x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:26:51Z,user_data=None,user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=8b6e6587-fddd-45bf-b295-e7eaace49948,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "address": "fa:16:3e:69:a2:08", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fffdf3-33", "ovs_interfaceid": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "address": "fa:16:3e:69:a2:08", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fffdf3-33", "ovs_interfaceid": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=c5fffdf3-3301-4b5b-b513-36c11c849eb4,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fffdf3-33') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG os_vif [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=c5fffdf3-3301-4b5b-b513-36c11c849eb4,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fffdf3-33') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5fffdf3-33, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5fffdf3-33, col_values=(('external_ids', {'iface-id': 'c5fffdf3-3301-4b5b-b513-36c11c849eb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:a2:08', 'vm-uuid': '8b6e6587-fddd-45bf-b295-e7eaace49948'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:10 user nova-compute[72818]: INFO os_vif [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=c5fffdf3-3301-4b5b-b513-36c11c849eb4,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fffdf3-33')
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:27:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] No VIF found with MAC fa:16:3e:69:a2:08, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:27:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-61fe636f-2b22-450a-9250-509ea3e39a3f req-f2f87a2b-8b5a-4e1c-87cb-48c9d8d427f2 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-61fe636f-2b22-450a-9250-509ea3e39a3f req-f2f87a2b-8b5a-4e1c-87cb-48c9d8d427f2 service nova] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-61fe636f-2b22-450a-9250-509ea3e39a3f req-f2f87a2b-8b5a-4e1c-87cb-48c9d8d427f2 service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-61fe636f-2b22-450a-9250-509ea3e39a3f req-f2f87a2b-8b5a-4e1c-87cb-48c9d8d427f2 service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-61fe636f-2b22-450a-9250-509ea3e39a3f req-f2f87a2b-8b5a-4e1c-87cb-48c9d8d427f2 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] No waiting events found dispatching network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:27:12 user nova-compute[72818]: WARNING nova.compute.manager [req-61fe636f-2b22-450a-9250-509ea3e39a3f req-f2f87a2b-8b5a-4e1c-87cb-48c9d8d427f2 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received unexpected event network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307632.28621, 92f865e1-d261-47e3-a64d-dc7bc6e7a93f => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:27:12 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] VM Resumed (Lifecycle Event)
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:27:12 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Instance spawned successfully.
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:27:12 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307632.288127, 92f865e1-d261-47e3-a64d-dc7bc6e7a93f => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:27:12 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] VM Started (Lifecycle Event)
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-44c29f4a-3393-49af-8a0a-9e4c96c0fc96 tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.784s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-14f3d088-24ed-4de4-a3ae-4979134bd33b req-a42ded21-c53a-4a81-a2d8-5588b34d6b4d service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Received event network-vif-plugged-c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-14f3d088-24ed-4de4-a3ae-4979134bd33b req-a42ded21-c53a-4a81-a2d8-5588b34d6b4d service nova] Acquiring lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-14f3d088-24ed-4de4-a3ae-4979134bd33b req-a42ded21-c53a-4a81-a2d8-5588b34d6b4d service nova] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-14f3d088-24ed-4de4-a3ae-4979134bd33b req-a42ded21-c53a-4a81-a2d8-5588b34d6b4d service nova] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-14f3d088-24ed-4de4-a3ae-4979134bd33b req-a42ded21-c53a-4a81-a2d8-5588b34d6b4d service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] No waiting events found dispatching network-vif-plugged-c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:27:12 user nova-compute[72818]: WARNING nova.compute.manager [req-14f3d088-24ed-4de4-a3ae-4979134bd33b req-a42ded21-c53a-4a81-a2d8-5588b34d6b4d service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Received unexpected event network-vif-plugged-c5fffdf3-3301-4b5b-b513-36c11c849eb4 for instance with vm_state building and task_state spawning.
Aug 17 21:27:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-5bd0e4ea-2051-4f9a-8501-4ed4ca12a42c req-e6af2516-dc3d-4fb6-a2fe-eb402f6621d3 service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Received event network-vif-plugged-c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:27:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5bd0e4ea-2051-4f9a-8501-4ed4ca12a42c req-e6af2516-dc3d-4fb6-a2fe-eb402f6621d3 service nova] Acquiring lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:27:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5bd0e4ea-2051-4f9a-8501-4ed4ca12a42c req-e6af2516-dc3d-4fb6-a2fe-eb402f6621d3 service nova] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:27:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5bd0e4ea-2051-4f9a-8501-4ed4ca12a42c req-e6af2516-dc3d-4fb6-a2fe-eb402f6621d3 service nova] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-5bd0e4ea-2051-4f9a-8501-4ed4ca12a42c req-e6af2516-dc3d-4fb6-a2fe-eb402f6621d3 service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] No waiting events found dispatching network-vif-plugged-c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:27:14 user nova-compute[72818]: WARNING nova.compute.manager [req-5bd0e4ea-2051-4f9a-8501-4ed4ca12a42c req-e6af2516-dc3d-4fb6-a2fe-eb402f6621d3 service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Received unexpected event network-vif-plugged-c5fffdf3-3301-4b5b-b513-36c11c849eb4 for instance with vm_state building and task_state spawning.
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307635.0616457, 8b6e6587-fddd-45bf-b295-e7eaace49948 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:27:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] VM Resumed (Lifecycle Event)
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:27:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Instance spawned successfully.
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:27:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307635.069788, 8b6e6587-fddd-45bf-b295-e7eaace49948 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:27:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] VM Started (Lifecycle Event)
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:27:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:27:15 user nova-compute[72818]: INFO nova.compute.manager [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Took 5.87 seconds to spawn the instance on the hypervisor.
Aug 17 21:27:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:27:15 user nova-compute[72818]: INFO nova.compute.manager [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Took 25.31 seconds to build instance.
Aug 17 21:27:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e8914def-3ebc-4b51-931a-ffd7e83fdf3b tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.431s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:27:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:20 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307625.746363, e8b5ccab-5dff-4458-a799-8c8528a032b1 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:27:20 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] VM Stopped (Lifecycle Event)
Aug 17 21:27:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-9431640c-2ef9-43b9-9aff-53f8c77a961d None None] [instance: e8b5ccab-5dff-4458-a799-8c8528a032b1] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:27:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:55 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:27:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:27:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:27:58 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:27:58 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:27:58 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:27:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:27:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:27:58 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:27:59 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updating instance_info_cache with network_info: [{"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:27:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:27:59 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:27:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:27:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:28:00 user nova-compute[72818]: INFO nova.compute.claims [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Claim successful on node user
Aug 17 21:28:00 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:28:00 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:28:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:28:00 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Creating image(s)
Aug 17 21:28:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "/opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "/opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "/opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:00 user nova-compute[72818]: DEBUG nova.policy [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ffa40080d9842b1a4f6a3e041b5d123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6bdddb43364e86b302c9c2e273fd44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk 1073741824" returned: 0 in 0.057s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.229s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Cannot resize image /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG nova.objects.instance [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'migration_context' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Ensure instance console log exists: /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:02 user nova-compute[72818]: DEBUG nova.network.neutron [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Successfully created port: ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:28:02 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:28:02 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:28:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:02 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:28:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:28:03 user nova-compute[72818]: INFO nova.compute.claims [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Claim successful on node user
Aug 17 21:28:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG nova.network.neutron [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Successfully updated port: ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquired lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG nova.network.neutron [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-6194518f-fb61-434e-8686-30907f68c80c req-5e4775b4-2e54-4946-bc49-28e5a24ec180 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-changed-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-6194518f-fb61-434e-8686-30907f68c80c req-5e4775b4-2e54-4946-bc49-28e5a24ec180 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Refreshing instance network info cache due to event network-changed-ff979858-3d61-4234-b7fc-f3f738f6e640. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6194518f-fb61-434e-8686-30907f68c80c req-5e4775b4-2e54-4946-bc49-28e5a24ec180 service nova] Acquiring lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:03 user nova-compute[72818]: DEBUG nova.network.neutron [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.765s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.network.neutron [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updating instance_info_cache with network_info: [{"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Releasing lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Instance network_info: |[{"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6194518f-fb61-434e-8686-30907f68c80c req-5e4775b4-2e54-4946-bc49-28e5a24ec180 service nova] Acquired lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.network.neutron [req-6194518f-fb61-434e-8686-30907f68c80c req-5e4775b4-2e54-4946-bc49-28e5a24ec180 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Refreshing network info cache for port ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Start _get_guest_xml network_info=[{"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:28:04 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:28:04 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2146804663',display_name='tempest-ServerRescueNegativeTestJSON-server-2146804663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2146804663',id=28,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV/pS7wUhm0egVv1NtGbx5/2A1E7cbIE5hKV5ijlKQsvO0xKD4ofO5CI2bFHmvs/MMU7DPVxjfa7iDVYpJ0GH7ksRIf1X2CzuVLFIO0pnHBbe6SeUNRQnv5JLq6KDzMyQ==',key_name='tempest-keypair-70771550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f6bdddb43364e86b302c9c2e273fd44',ramdisk_id='',reservation_id='r-s734dqvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-713886303',owner_user_name='tempest-ServerRescueNegativeTestJSON-713886303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:28:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa40080d9842b1a4f6a3e041b5d123',uuid=e15761ac-028d-40a9-931d-51ef8b77c1cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converting VIF {"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d9:ba,bridge_name='br-int',has_traffic_filtering=True,id=ff979858-3d61-4234-b7fc-f3f738f6e640,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff979858-3d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.objects.instance [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'pci_devices' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:28:04 user nova-compute[72818]:   <uuid>e15761ac-028d-40a9-931d-51ef8b77c1cf</uuid>
Aug 17 21:28:04 user nova-compute[72818]:   <name>instance-0000001c</name>
Aug 17 21:28:04 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:28:04 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:28:04 user nova-compute[72818]:   <metadata>
Aug 17 21:28:04 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:28:04 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:28:04 user nova-compute[72818]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2146804663</nova:name>
Aug 17 21:28:04 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:28:04</nova:creationTime>
Aug 17 21:28:04 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:28:04 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:28:04 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:28:04 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:28:04 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:28:04 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:28:04 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:28:04 user nova-compute[72818]:       <nova:owner>
Aug 17 21:28:04 user nova-compute[72818]:         <nova:user uuid="8ffa40080d9842b1a4f6a3e041b5d123">tempest-ServerRescueNegativeTestJSON-713886303-project-member</nova:user>
Aug 17 21:28:04 user nova-compute[72818]:         <nova:project uuid="7f6bdddb43364e86b302c9c2e273fd44">tempest-ServerRescueNegativeTestJSON-713886303</nova:project>
Aug 17 21:28:04 user nova-compute[72818]:       </nova:owner>
Aug 17 21:28:04 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:28:04 user nova-compute[72818]:       <nova:ports>
Aug 17 21:28:04 user nova-compute[72818]:         <nova:port uuid="ff979858-3d61-4234-b7fc-f3f738f6e640">
Aug 17 21:28:04 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 21:28:04 user nova-compute[72818]:         </nova:port>
Aug 17 21:28:04 user nova-compute[72818]:       </nova:ports>
Aug 17 21:28:04 user nova-compute[72818]:     </nova:instance>
Aug 17 21:28:04 user nova-compute[72818]:   </metadata>
Aug 17 21:28:04 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:28:04 user nova-compute[72818]:     <system>
Aug 17 21:28:04 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:28:04 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:28:04 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:28:04 user nova-compute[72818]:       <entry name="serial">e15761ac-028d-40a9-931d-51ef8b77c1cf</entry>
Aug 17 21:28:04 user nova-compute[72818]:       <entry name="uuid">e15761ac-028d-40a9-931d-51ef8b77c1cf</entry>
Aug 17 21:28:04 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:28:04 user nova-compute[72818]:     </system>
Aug 17 21:28:04 user nova-compute[72818]:   </sysinfo>
Aug 17 21:28:04 user nova-compute[72818]:   <os>
Aug 17 21:28:04 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:28:04 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:28:04 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:28:04 user nova-compute[72818]:   </os>
Aug 17 21:28:04 user nova-compute[72818]:   <features>
Aug 17 21:28:04 user nova-compute[72818]:     <acpi/>
Aug 17 21:28:04 user nova-compute[72818]:     <apic/>
Aug 17 21:28:04 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:28:04 user nova-compute[72818]:   </features>
Aug 17 21:28:04 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:28:04 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:28:04 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:28:04 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:28:04 user nova-compute[72818]:   </clock>
Aug 17 21:28:04 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:28:04 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:28:04 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:28:04 user nova-compute[72818]:   </cpu>
Aug 17 21:28:04 user nova-compute[72818]:   <devices>
Aug 17 21:28:04 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:28:04 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:28:04 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk"/>
Aug 17 21:28:04 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:28:04 user nova-compute[72818]:     </disk>
Aug 17 21:28:04 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:28:04 user nova-compute[72818]:       <mac address="fa:16:3e:c4:d9:ba"/>
Aug 17 21:28:04 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:28:04 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:28:04 user nova-compute[72818]:       <target dev="tapff979858-3d"/>
Aug 17 21:28:04 user nova-compute[72818]:     </interface>
Aug 17 21:28:04 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:28:04 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/console.log" append="off"/>
Aug 17 21:28:04 user nova-compute[72818]:     </serial>
Aug 17 21:28:04 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:28:04 user nova-compute[72818]:     <video>
Aug 17 21:28:04 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:28:04 user nova-compute[72818]:     </video>
Aug 17 21:28:04 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:28:04 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:28:04 user nova-compute[72818]:     </rng>
Aug 17 21:28:04 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:28:04 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:28:04 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:28:04 user nova-compute[72818]:     </memballoon>
Aug 17 21:28:04 user nova-compute[72818]:   </devices>
Aug 17 21:28:04 user nova-compute[72818]: </domain>
Aug 17 21:28:04 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2146804663',display_name='tempest-ServerRescueNegativeTestJSON-server-2146804663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2146804663',id=28,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV/pS7wUhm0egVv1NtGbx5/2A1E7cbIE5hKV5ijlKQsvO0xKD4ofO5CI2bFHmvs/MMU7DPVxjfa7iDVYpJ0GH7ksRIf1X2CzuVLFIO0pnHBbe6SeUNRQnv5JLq6KDzMyQ==',key_name='tempest-keypair-70771550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f6bdddb43364e86b302c9c2e273fd44',ramdisk_id='',reservation_id='r-s734dqvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-713886303',owner_user_name='tempest-ServerRescueNegativeTestJSON-713886303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:28:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa40080d9842b1a4f6a3e041b5d123',uuid=e15761ac-028d-40a9-931d-51ef8b77c1cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converting VIF {"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d9:ba,bridge_name='br-int',has_traffic_filtering=True,id=ff979858-3d61-4234-b7fc-f3f738f6e640,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff979858-3d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG os_vif [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d9:ba,bridge_name='br-int',has_traffic_filtering=True,id=ff979858-3d61-4234-b7fc-f3f738f6e640,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff979858-3d') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:28:04 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:28:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff979858-3d, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff979858-3d, col_values=(('external_ids', {'iface-id': 'ff979858-3d61-4234-b7fc-f3f738f6e640', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:d9:ba', 'vm-uuid': 'e15761ac-028d-40a9-931d-51ef8b77c1cf'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:04 user nova-compute[72818]: INFO os_vif [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d9:ba,bridge_name='br-int',has_traffic_filtering=True,id=ff979858-3d61-4234-b7fc-f3f738f6e640,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff979858-3d')
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No VIF found with MAC fa:16:3e:c4:d9:ba, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:28:04 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Creating image(s)
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "/opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "/opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "/opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.policy [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10aff1c23f1041c485ab50735d2dcc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6482e624bb9417598bb26fa0622641d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.network.neutron [req-6194518f-fb61-434e-8686-30907f68c80c req-5e4775b4-2e54-4946-bc49-28e5a24ec180 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updated VIF entry in instance network info cache for port ff979858-3d61-4234-b7fc-f3f738f6e640. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG nova.network.neutron [req-6194518f-fb61-434e-8686-30907f68c80c req-5e4775b4-2e54-4946-bc49-28e5a24ec180 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updating instance_info_cache with network_info: [{"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6194518f-fb61-434e-8686-30907f68c80c req-5e4775b4-2e54-4946-bc49-28e5a24ec180 service nova] Releasing lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk 1073741824" returned: 0 in 0.121s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Cannot resize image /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG nova.objects.instance [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'migration_context' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Ensure instance console log exists: /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:28:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-e07631e6-640d-412b-8e2e-f41763f7b8a4 req-25819346-df77-423e-b380-26333d9f2c49 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e07631e6-640d-412b-8e2e-f41763f7b8a4 req-25819346-df77-423e-b380-26333d9f2c49 service nova] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e07631e6-640d-412b-8e2e-f41763f7b8a4 req-25819346-df77-423e-b380-26333d9f2c49 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e07631e6-640d-412b-8e2e-f41763f7b8a4 req-25819346-df77-423e-b380-26333d9f2c49 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-e07631e6-640d-412b-8e2e-f41763f7b8a4 req-25819346-df77-423e-b380-26333d9f2c49 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] No waiting events found dispatching network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:06 user nova-compute[72818]: WARNING nova.compute.manager [req-e07631e6-640d-412b-8e2e-f41763f7b8a4 req-25819346-df77-423e-b380-26333d9f2c49 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received unexpected event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 for instance with vm_state building and task_state spawning.
Aug 17 21:28:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Successfully created port: 5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307688.372206, e15761ac-028d-40a9-931d-51ef8b77c1cf => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:28:08 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] VM Resumed (Lifecycle Event)
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Successfully updated port: 5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-aa065414-d7c0-4f7e-b81c-4b25b33862fd req-18cc6344-eb4f-4c27-9eb5-58b2a72a833e service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-changed-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-aa065414-d7c0-4f7e-b81c-4b25b33862fd req-18cc6344-eb4f-4c27-9eb5-58b2a72a833e service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Refreshing instance network info cache due to event network-changed-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-aa065414-d7c0-4f7e-b81c-4b25b33862fd req-18cc6344-eb4f-4c27-9eb5-58b2a72a833e service nova] Acquiring lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-aa065414-d7c0-4f7e-b81c-4b25b33862fd req-18cc6344-eb4f-4c27-9eb5-58b2a72a833e service nova] Acquired lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.network.neutron [req-aa065414-d7c0-4f7e-b81c-4b25b33862fd req-18cc6344-eb4f-4c27-9eb5-58b2a72a833e service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Refreshing network info cache for port 5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-9dea18ce-451f-44ab-aeb1-82dfb8c3d1c8 req-7035d951-374d-4772-b412-1bf3519795a9 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9dea18ce-451f-44ab-aeb1-82dfb8c3d1c8 req-7035d951-374d-4772-b412-1bf3519795a9 service nova] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9dea18ce-451f-44ab-aeb1-82dfb8c3d1c8 req-7035d951-374d-4772-b412-1bf3519795a9 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9dea18ce-451f-44ab-aeb1-82dfb8c3d1c8 req-7035d951-374d-4772-b412-1bf3519795a9 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-9dea18ce-451f-44ab-aeb1-82dfb8c3d1c8 req-7035d951-374d-4772-b412-1bf3519795a9 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] No waiting events found dispatching network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:08 user nova-compute[72818]: WARNING nova.compute.manager [req-9dea18ce-451f-44ab-aeb1-82dfb8c3d1c8 req-7035d951-374d-4772-b412-1bf3519795a9 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received unexpected event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 for instance with vm_state building and task_state spawning.
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:28:08 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Instance spawned successfully.
Aug 17 21:28:08 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:28:08 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7240MB free_disk=25.338790893554688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:28:08 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307688.3731625, e15761ac-028d-40a9-931d-51ef8b77c1cf => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:28:08 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] VM Started (Lifecycle Event)
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.network.neutron [req-aa065414-d7c0-4f7e-b81c-4b25b33862fd req-18cc6344-eb4f-4c27-9eb5-58b2a72a833e service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:28:08 user nova-compute[72818]: INFO nova.compute.manager [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Took 7.98 seconds to spawn the instance on the hypervisor.
Aug 17 21:28:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:08 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 774642dc-1888-4f4e-9485-b6dfe7ad6a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 6c46354a-2316-4703-b7fb-431fa37df1ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance d54920e2-56cf-4c58-b66a-a454470c57d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8b6e6587-fddd-45bf-b295-e7eaace49948 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 92f865e1-d261-47e3-a64d-dc7bc6e7a93f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e15761ac-028d-40a9-931d-51ef8b77c1cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:28:09 user nova-compute[72818]: INFO nova.compute.manager [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Took 8.88 seconds to build instance.
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.network.neutron [req-aa065414-d7c0-4f7e-b81c-4b25b33862fd req-18cc6344-eb4f-4c27-9eb5-58b2a72a833e service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-aa065414-d7c0-4f7e-b81c-4b25b33862fd req-18cc6344-eb4f-4c27-9eb5-58b2a72a833e service nova] Releasing lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquired lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08184c9c-cef0-4e56-a2b0-a66482e2dc65 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.021s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.817s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Updating instance_info_cache with network_info: [{"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Releasing lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance network_info: |[{"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Start _get_guest_xml network_info=[{"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:28:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:28:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1630001746',display_name='tempest-AttachVolumeTestJSON-server-1630001746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1630001746',id=29,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUZBvBBpmxnbCIWpS4jBvvAKyP0bQz/vTtdwsd7hEqD4r8z1NOmBaGEjW/K67Sh9o5eiqiRV1WPAPKHJZxGhSDnnIJOt7TtiEiP50gowTOal29LQ0rCa9uTNGAxeT0cnw==',key_name='tempest-keypair-392288452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6482e624bb9417598bb26fa0622641d',ramdisk_id='',reservation_id='r-snuu5rli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1086990444',owner_user_name='tempest-AttachVolumeTestJSON-1086990444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10aff1c23f1041c485ab50735d2dcc12',uuid=e322a0ce-e887-4e29-a5c4-a0da74db3c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converting VIF {"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.objects.instance [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'pci_devices' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:28:09 user nova-compute[72818]:   <uuid>e322a0ce-e887-4e29-a5c4-a0da74db3c7f</uuid>
Aug 17 21:28:09 user nova-compute[72818]:   <name>instance-0000001d</name>
Aug 17 21:28:09 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:28:09 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:28:09 user nova-compute[72818]:   <metadata>
Aug 17 21:28:09 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:28:09 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:28:09 user nova-compute[72818]:       <nova:name>tempest-AttachVolumeTestJSON-server-1630001746</nova:name>
Aug 17 21:28:09 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:28:09</nova:creationTime>
Aug 17 21:28:09 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:28:09 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:28:09 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:28:09 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:28:09 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:28:09 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:28:09 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:28:09 user nova-compute[72818]:       <nova:owner>
Aug 17 21:28:09 user nova-compute[72818]:         <nova:user uuid="10aff1c23f1041c485ab50735d2dcc12">tempest-AttachVolumeTestJSON-1086990444-project-member</nova:user>
Aug 17 21:28:09 user nova-compute[72818]:         <nova:project uuid="d6482e624bb9417598bb26fa0622641d">tempest-AttachVolumeTestJSON-1086990444</nova:project>
Aug 17 21:28:09 user nova-compute[72818]:       </nova:owner>
Aug 17 21:28:09 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:28:09 user nova-compute[72818]:       <nova:ports>
Aug 17 21:28:09 user nova-compute[72818]:         <nova:port uuid="5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d">
Aug 17 21:28:09 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 21:28:09 user nova-compute[72818]:         </nova:port>
Aug 17 21:28:09 user nova-compute[72818]:       </nova:ports>
Aug 17 21:28:09 user nova-compute[72818]:     </nova:instance>
Aug 17 21:28:09 user nova-compute[72818]:   </metadata>
Aug 17 21:28:09 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:28:09 user nova-compute[72818]:     <system>
Aug 17 21:28:09 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:28:09 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:28:09 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:28:09 user nova-compute[72818]:       <entry name="serial">e322a0ce-e887-4e29-a5c4-a0da74db3c7f</entry>
Aug 17 21:28:09 user nova-compute[72818]:       <entry name="uuid">e322a0ce-e887-4e29-a5c4-a0da74db3c7f</entry>
Aug 17 21:28:09 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:28:09 user nova-compute[72818]:     </system>
Aug 17 21:28:09 user nova-compute[72818]:   </sysinfo>
Aug 17 21:28:09 user nova-compute[72818]:   <os>
Aug 17 21:28:09 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:28:09 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:28:09 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:28:09 user nova-compute[72818]:   </os>
Aug 17 21:28:09 user nova-compute[72818]:   <features>
Aug 17 21:28:09 user nova-compute[72818]:     <acpi/>
Aug 17 21:28:09 user nova-compute[72818]:     <apic/>
Aug 17 21:28:09 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:28:09 user nova-compute[72818]:   </features>
Aug 17 21:28:09 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:28:09 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:28:09 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:28:09 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:28:09 user nova-compute[72818]:   </clock>
Aug 17 21:28:09 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:28:09 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:28:09 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:28:09 user nova-compute[72818]:   </cpu>
Aug 17 21:28:09 user nova-compute[72818]:   <devices>
Aug 17 21:28:09 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:28:09 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:28:09 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk"/>
Aug 17 21:28:09 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:28:09 user nova-compute[72818]:     </disk>
Aug 17 21:28:09 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:28:09 user nova-compute[72818]:       <mac address="fa:16:3e:dc:c2:13"/>
Aug 17 21:28:09 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:28:09 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:28:09 user nova-compute[72818]:       <target dev="tap5a8f5ce4-c8"/>
Aug 17 21:28:09 user nova-compute[72818]:     </interface>
Aug 17 21:28:09 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:28:09 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/console.log" append="off"/>
Aug 17 21:28:09 user nova-compute[72818]:     </serial>
Aug 17 21:28:09 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:28:09 user nova-compute[72818]:     <video>
Aug 17 21:28:09 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:28:09 user nova-compute[72818]:     </video>
Aug 17 21:28:09 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:28:09 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:28:09 user nova-compute[72818]:     </rng>
Aug 17 21:28:09 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:28:09 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:28:09 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:28:09 user nova-compute[72818]:     </memballoon>
Aug 17 21:28:09 user nova-compute[72818]:   </devices>
Aug 17 21:28:09 user nova-compute[72818]: </domain>
Aug 17 21:28:09 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1630001746',display_name='tempest-AttachVolumeTestJSON-server-1630001746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1630001746',id=29,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUZBvBBpmxnbCIWpS4jBvvAKyP0bQz/vTtdwsd7hEqD4r8z1NOmBaGEjW/K67Sh9o5eiqiRV1WPAPKHJZxGhSDnnIJOt7TtiEiP50gowTOal29LQ0rCa9uTNGAxeT0cnw==',key_name='tempest-keypair-392288452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6482e624bb9417598bb26fa0622641d',ramdisk_id='',reservation_id='r-snuu5rli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1086990444',owner_user_name='tempest-AttachVolumeTestJSON-1086990444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10aff1c23f1041c485ab50735d2dcc12',uuid=e322a0ce-e887-4e29-a5c4-a0da74db3c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converting VIF {"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG os_vif [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a8f5ce4-c8, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a8f5ce4-c8, col_values=(('external_ids', {'iface-id': '5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:c2:13', 'vm-uuid': 'e322a0ce-e887-4e29-a5c4-a0da74db3c7f'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:09 user nova-compute[72818]: INFO os_vif [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8')
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:28:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No VIF found with MAC fa:16:3e:dc:c2:13, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:28:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:28:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:28:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-6ab47dc3-096d-4ab8-8814-035768fdd900 req-5619e42e-2892-4c22-bdfd-a2490973a8eb service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6ab47dc3-096d-4ab8-8814-035768fdd900 req-5619e42e-2892-4c22-bdfd-a2490973a8eb service nova] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6ab47dc3-096d-4ab8-8814-035768fdd900 req-5619e42e-2892-4c22-bdfd-a2490973a8eb service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6ab47dc3-096d-4ab8-8814-035768fdd900 req-5619e42e-2892-4c22-bdfd-a2490973a8eb service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-6ab47dc3-096d-4ab8-8814-035768fdd900 req-5619e42e-2892-4c22-bdfd-a2490973a8eb service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] No waiting events found dispatching network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:11 user nova-compute[72818]: WARNING nova.compute.manager [req-6ab47dc3-096d-4ab8-8814-035768fdd900 req-5619e42e-2892-4c22-bdfd-a2490973a8eb service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received unexpected event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d for instance with vm_state building and task_state spawning.
Aug 17 21:28:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:12 user nova-compute[72818]: INFO nova.compute.manager [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Rescuing
Aug 17 21:28:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "refresh_cache-d54920e2-56cf-4c58-b66a-a454470c57d6" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:28:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquired lock "refresh_cache-d54920e2-56cf-4c58-b66a-a454470c57d6" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:28:12 user nova-compute[72818]: DEBUG nova.network.neutron [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307693.6821883, e322a0ce-e887-4e29-a5c4-a0da74db3c7f => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:28:13 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] VM Resumed (Lifecycle Event)
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.network.neutron [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Updating instance_info_cache with network_info: [{"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:28:13 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance spawned successfully.
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Releasing lock "refresh_cache-d54920e2-56cf-4c58-b66a-a454470c57d6" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-629d5b49-38ed-4c1e-93d4-13edb0906c12 req-5b3e2395-84da-4ad5-8d8e-9af0d110f390 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-629d5b49-38ed-4c1e-93d4-13edb0906c12 req-5b3e2395-84da-4ad5-8d8e-9af0d110f390 service nova] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-629d5b49-38ed-4c1e-93d4-13edb0906c12 req-5b3e2395-84da-4ad5-8d8e-9af0d110f390 service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-629d5b49-38ed-4c1e-93d4-13edb0906c12 req-5b3e2395-84da-4ad5-8d8e-9af0d110f390 service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-629d5b49-38ed-4c1e-93d4-13edb0906c12 req-5b3e2395-84da-4ad5-8d8e-9af0d110f390 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] No waiting events found dispatching network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:13 user nova-compute[72818]: WARNING nova.compute.manager [req-629d5b49-38ed-4c1e-93d4-13edb0906c12 req-5b3e2395-84da-4ad5-8d8e-9af0d110f390 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received unexpected event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d for instance with vm_state building and task_state spawning.
Aug 17 21:28:13 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307693.6841433, e322a0ce-e887-4e29-a5c4-a0da74db3c7f => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:28:13 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] VM Started (Lifecycle Event)
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:28:13 user nova-compute[72818]: INFO nova.compute.manager [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Took 9.39 seconds to spawn the instance on the hypervisor.
Aug 17 21:28:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:13 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:28:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:13 user nova-compute[72818]: INFO nova.compute.manager [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Took 10.64 seconds to build instance.
Aug 17 21:28:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a84dffb-a38a-46e8-a389-5d243abdbaae tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.062s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-236b5674-5e46-476f-aaa0-8c657f236522 req-bb64ad80-f5eb-469a-8150-480c9ee110dd service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-unplugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-236b5674-5e46-476f-aaa0-8c657f236522 req-bb64ad80-f5eb-469a-8150-480c9ee110dd service nova] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-236b5674-5e46-476f-aaa0-8c657f236522 req-bb64ad80-f5eb-469a-8150-480c9ee110dd service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-236b5674-5e46-476f-aaa0-8c657f236522 req-bb64ad80-f5eb-469a-8150-480c9ee110dd service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-236b5674-5e46-476f-aaa0-8c657f236522 req-bb64ad80-f5eb-469a-8150-480c9ee110dd service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] No waiting events found dispatching network-vif-unplugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:14 user nova-compute[72818]: WARNING nova.compute.manager [req-236b5674-5e46-476f-aaa0-8c657f236522 req-bb64ad80-f5eb-469a-8150-480c9ee110dd service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received unexpected event network-vif-unplugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac for instance with vm_state active and task_state rescuing.
Aug 17 21:28:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:14 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Instance destroyed successfully.
Aug 17 21:28:14 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Attempting a stable device rescue
Aug 17 21:28:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72818) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Instance directory exists: not creating {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 21:28:14 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Creating image(s)
Aug 17 21:28:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "/opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "/opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "/opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG nova.objects.instance [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'trusted_certs' on Instance uuid d54920e2-56cf-4c58-b66a-a454470c57d6 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "8c91eb155e1478580b8c0bb9e22bb5f250d830fd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "8c91eb155e1478580b8c0bb9e22bb5f250d830fd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd.part --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-c3314427-0e8f-4fd5-9527-6ecf95799b93 req-813765eb-ed32-4abe-ab74-a02d5f3de977 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c3314427-0e8f-4fd5-9527-6ecf95799b93 req-813765eb-ed32-4abe-ab74-a02d5f3de977 service nova] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c3314427-0e8f-4fd5-9527-6ecf95799b93 req-813765eb-ed32-4abe-ab74-a02d5f3de977 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c3314427-0e8f-4fd5-9527-6ecf95799b93 req-813765eb-ed32-4abe-ab74-a02d5f3de977 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-c3314427-0e8f-4fd5-9527-6ecf95799b93 req-813765eb-ed32-4abe-ab74-a02d5f3de977 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] No waiting events found dispatching network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:16 user nova-compute[72818]: WARNING nova.compute.manager [req-c3314427-0e8f-4fd5-9527-6ecf95799b93 req-813765eb-ed32-4abe-ab74-a02d5f3de977 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received unexpected event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac for instance with vm_state active and task_state rescuing.
Aug 17 21:28:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd.part --force-share --output=json" returned: 0 in 0.231s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG nova.virt.images [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] 10e320b8-f3d9-4619-8a57-972156987089 was qcow2, converting to raw {{(pid=72818) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd.part /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd.converted {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd.part /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd.converted" returned: 0 in 0.522s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd.converted --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd.converted --force-share --output=json" returned: 0 in 0.234s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "8c91eb155e1478580b8c0bb9e22bb5f250d830fd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.318s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "8c91eb155e1478580b8c0bb9e22bb5f250d830fd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "8c91eb155e1478580b8c0bb9e22bb5f250d830fd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd --force-share --output=json" returned: 0 in 0.280s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd,backing_fmt=raw /opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/disk.rescue {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd,backing_fmt=raw /opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/disk.rescue" returned: 0 in 0.057s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "8c91eb155e1478580b8c0bb9e22bb5f250d830fd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.objects.instance [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'migration_context' on Instance uuid d54920e2-56cf-4c58-b66a-a454470c57d6 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Start _get_guest_xml network_info=[{"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "vif_mac": "fa:16:3e:4f:f9:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '10e320b8-f3d9-4619-8a57-972156987089', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '73a7af62-e4d8-4a84-8fe7-fa5f40060580', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIDTCLwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd54920e2-56cf-4c58-b66a-a454470c57d6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea63b9f0-bd73-47dd-8514-101d77b604a6', 'serial': 'ea63b9f0-bd73-47dd-8514-101d77b604a6'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.objects.instance [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'resources' on Instance uuid d54920e2-56cf-4c58-b66a-a454470c57d6 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.objects.instance [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'numa_topology' on Instance uuid d54920e2-56cf-4c58-b66a-a454470c57d6 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:17 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:28:17 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.objects.instance [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'vcpu_model' on Instance uuid d54920e2-56cf-4c58-b66a-a454470c57d6 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIDTCLwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:28:17 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:28:17 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:28:17 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcbc3ae-906f-4c04-96ea-df57f8f88533]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NIDTCLwW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 21:28:17 user nova-compute[72818]: node.name = iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6
Aug 17 21:28:17 user nova-compute[72818]: node.tpgt = -1
Aug 17 21:28:17 user nova-compute[72818]: node.startup = automatic
Aug 17 21:28:17 user nova-compute[72818]: node.leading_login = No
Aug 17 21:28:17 user nova-compute[72818]: iface.iscsi_ifacename = default
Aug 17 21:28:17 user nova-compute[72818]: iface.net_ifacename = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.ipaddress = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.prefix_len = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.hwaddress = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.transport_name = tcp
Aug 17 21:28:17 user nova-compute[72818]: iface.initiatorname = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.state = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.vlan_id = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.vlan_priority = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.vlan_state = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.iface_num = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.mtu = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.port = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.bootproto = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.subnet_mask = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.gateway = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.dhcp_alt_client_id = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.dhcp_dns = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.dhcp_learn_iqn = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.dhcp_vendor_id_state = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.dhcp_vendor_id = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.dhcp_slp_da = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.fragmentation = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.gratuitous_arp = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.incoming_forwarding = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.tos_state = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.tos = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.ttl = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.delayed_ack = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.tcp_nagle = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.tcp_wsf_state = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.tcp_wsf = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.tcp_timer_scale = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.tcp_timestamp = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.redirect = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.def_task_mgmt_timeout = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.header_digest = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.data_digest = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.immediate_data = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.initial_r2t = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.data_seq_inorder = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.data_pdu_inorder = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.erl = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.max_receive_data_len = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.first_burst_len = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.max_outstanding_r2t = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.max_burst_len = 0
Aug 17 21:28:17 user nova-compute[72818]: iface.chap_auth = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.bidi_chap = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.strict_login_compliance = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.discovery_auth = <empty>
Aug 17 21:28:17 user nova-compute[72818]: iface.discovery_logout = <empty>
Aug 17 21:28:17 user nova-compute[72818]: node.discovery_address = <empty>
Aug 17 21:28:17 user nova-compute[72818]: node.discovery_port = 0
Aug 17 21:28:17 user nova-compute[72818]: node.discovery_type = static
Aug 17 21:28:17 user nova-compute[72818]: node.session.initial_cmdsn = 0
Aug 17 21:28:17 user nova-compute[72818]: node.session.initial_login_retry_max = 8
Aug 17 21:28:17 user nova-compute[72818]: node.session.xmit_thread_priority = -20
Aug 17 21:28:17 user nova-compute[72818]: node.session.cmds_max = 128
Aug 17 21:28:17 user nova-compute[72818]: node.session.queue_depth = 32
Aug 17 21:28:17 user nova-compute[72818]: node.session.nr_sessions = 1
Aug 17 21:28:17 user nova-compute[72818]: node.session.auth.authmethod = CHAP
Aug 17 21:28:17 user nova-compute[72818]: node.session.auth.username = NIDTCLwW
Aug 17 21:28:17 user nova-compute[72818]: node.session.auth.password = ***
Aug 17 21:28:17 user nova-compute[72818]: node.session.auth.username_in = <empty>
Aug 17 21:28:17 user nova-compute[72818]: node.session.auth.password_in = <empty>
Aug 17 21:28:17 user nova-compute[72818]: node.session.auth.chap_algs = MD5
Aug 17 21:28:17 user nova-compute[72818]: node.session.timeo.replacement_timeout = 120
Aug 17 21:28:17 user nova-compute[72818]: node.session.err_timeo.abort_timeout = 15
Aug 17 21:28:17 user nova-compute[72818]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 21:28:17 user nova-compute[72818]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 21:28:17 user nova-compute[72818]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 21:28:17 user nova-compute[72818]: node.session.iscsi.FastAbort = Yes
Aug 17 21:28:17 user nova-compute[72818]: node.session.iscsi.InitialR2T = No
Aug 17 21:28:17 user nova-compute[72818]: node.session.iscsi.ImmediateData = Yes
Aug 17 21:28:17 user nova-compute[72818]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 21:28:17 user nova-compute[72818]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 21:28:17 user nova-compute[72818]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 21:28:17 user nova-compute[72818]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 21:28:17 user nova-compute[72818]: node.session.iscsi.MaxConnections = 1
Aug 17 21:28:17 user nova-compute[72818]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 21:28:17 user nova-compute[72818]: node.session.iscsi.ERL = 0
Aug 17 21:28:17 user nova-compute[72818]: node.session.scan = manual
Aug 17 21:28:17 user nova-compute[72818]: node.session.reopen_max = 0
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].address = 172.16.0.220
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].port = 3260
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].startup = manual
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].tcp.window_size = 524288
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].tcp.type_of_service = 0
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].timeo.logout_timeout = 15
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].timeo.login_timeout = 15
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].timeo.auth_timeout = 45
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].iscsi.DataDigest = None
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].iscsi.IFMarker = No
Aug 17 21:28:17 user nova-compute[72818]: node.conn[0].iscsi.OFMarker = No
Aug 17 21:28:17 user nova-compute[72818]: # END RECORD
Aug 17 21:28:17 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd5f144-b3ac-45aa-9eff-96434e0a0ca1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf5bd9a-d736-4a30-96e1-8fcbe3bb56ad]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIDTCLwW {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIDTCLwW" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb044a5-faba-4ab6-8288-a5e5b9bb5fe4]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NIDTCLwW'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dac8fd-b6bf-47ff-8ec7-3ae3d3b003d8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07db94e-e466-4856-ad42-cdc418f23b0f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:28:17 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:28:17 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:28:17 user nova-compute[72818]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:28:17 user nova-compute[72818]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 (non-flash)
Aug 17 21:28:17 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:28:17 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:28:17 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:28:17 user nova-compute[72818]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:28:17 user nova-compute[72818]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 (non-flash)
Aug 17 21:28:17 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.170s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] HCTL ('34', '0', '0', 0) found on session 28 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cb7135-3ec5-45e6-94c1-4cfbc49f3ed3]: (4, ('0 0 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Searching for a device in session 28 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIDTCLwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.199s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] <== connect_volume: return (200ms) {'type': 'block', 'scsi_wwn': '26339636632643065', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339636632643065', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-108339640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-108339640',id=26,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:27:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-7pe9h1h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:27:09Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=d54920e2-56cf-4c58-b66a-a454470c57d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "vif_mac": "fa:16:3e:4f:f9:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "vif_mac": "fa:16:3e:4f:f9:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=87206248-7cbe-48b7-b3f5-72ffb02ddfac,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87206248-7c') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.objects.instance [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'pci_devices' on Instance uuid d54920e2-56cf-4c58-b66a-a454470c57d6 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:28:17 user nova-compute[72818]:   <uuid>d54920e2-56cf-4c58-b66a-a454470c57d6</uuid>
Aug 17 21:28:17 user nova-compute[72818]:   <name>instance-0000001a</name>
Aug 17 21:28:17 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:28:17 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:28:17 user nova-compute[72818]:   <metadata>
Aug 17 21:28:17 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:28:17 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:28:17 user nova-compute[72818]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-108339640</nova:name>
Aug 17 21:28:17 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:28:17</nova:creationTime>
Aug 17 21:28:17 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:28:17 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:28:17 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:28:17 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:28:17 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:28:17 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:28:17 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:28:17 user nova-compute[72818]:       <nova:owner>
Aug 17 21:28:17 user nova-compute[72818]:         <nova:user uuid="6cd1f219a2634975bb1362620392dc1a">tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member</nova:user>
Aug 17 21:28:17 user nova-compute[72818]:         <nova:project uuid="dda0b81a8a39436a9ec6e1646090f637">tempest-ServerBootFromVolumeStableRescueTest-1074783662</nova:project>
Aug 17 21:28:17 user nova-compute[72818]:       </nova:owner>
Aug 17 21:28:17 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:28:17 user nova-compute[72818]:       <nova:ports>
Aug 17 21:28:17 user nova-compute[72818]:         <nova:port uuid="87206248-7cbe-48b7-b3f5-72ffb02ddfac">
Aug 17 21:28:17 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 21:28:17 user nova-compute[72818]:         </nova:port>
Aug 17 21:28:17 user nova-compute[72818]:       </nova:ports>
Aug 17 21:28:17 user nova-compute[72818]:     </nova:instance>
Aug 17 21:28:17 user nova-compute[72818]:   </metadata>
Aug 17 21:28:17 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:28:17 user nova-compute[72818]:     <system>
Aug 17 21:28:17 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:28:17 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:28:17 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:28:17 user nova-compute[72818]:       <entry name="serial">d54920e2-56cf-4c58-b66a-a454470c57d6</entry>
Aug 17 21:28:17 user nova-compute[72818]:       <entry name="uuid">d54920e2-56cf-4c58-b66a-a454470c57d6</entry>
Aug 17 21:28:17 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:28:17 user nova-compute[72818]:     </system>
Aug 17 21:28:17 user nova-compute[72818]:   </sysinfo>
Aug 17 21:28:17 user nova-compute[72818]:   <os>
Aug 17 21:28:17 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:28:17 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:28:17 user nova-compute[72818]:   </os>
Aug 17 21:28:17 user nova-compute[72818]:   <features>
Aug 17 21:28:17 user nova-compute[72818]:     <acpi/>
Aug 17 21:28:17 user nova-compute[72818]:     <apic/>
Aug 17 21:28:17 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:28:17 user nova-compute[72818]:   </features>
Aug 17 21:28:17 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:28:17 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:28:17 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:28:17 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:28:17 user nova-compute[72818]:   </clock>
Aug 17 21:28:17 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:28:17 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:28:17 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:28:17 user nova-compute[72818]:   </cpu>
Aug 17 21:28:17 user nova-compute[72818]:   <devices>
Aug 17 21:28:17 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:28:17 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:28:17 user nova-compute[72818]:       <source dev="/dev/sdc"/>
Aug 17 21:28:17 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:28:17 user nova-compute[72818]:       <serial>ea63b9f0-bd73-47dd-8514-101d77b604a6</serial>
Aug 17 21:28:17 user nova-compute[72818]:     </disk>
Aug 17 21:28:17 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:28:17 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:28:17 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/disk.rescue"/>
Aug 17 21:28:17 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:28:17 user nova-compute[72818]:       <boot order="1"/>
Aug 17 21:28:17 user nova-compute[72818]:     </disk>
Aug 17 21:28:17 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:28:17 user nova-compute[72818]:       <mac address="fa:16:3e:4f:f9:56"/>
Aug 17 21:28:17 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:28:17 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:28:17 user nova-compute[72818]:       <target dev="tap87206248-7c"/>
Aug 17 21:28:17 user nova-compute[72818]:     </interface>
Aug 17 21:28:17 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:28:17 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/console.log" append="off"/>
Aug 17 21:28:17 user nova-compute[72818]:     </serial>
Aug 17 21:28:17 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:28:17 user nova-compute[72818]:     <video>
Aug 17 21:28:17 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:28:17 user nova-compute[72818]:     </video>
Aug 17 21:28:17 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:28:17 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:28:17 user nova-compute[72818]:     </rng>
Aug 17 21:28:17 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:28:17 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:28:17 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:28:17 user nova-compute[72818]:     </memballoon>
Aug 17 21:28:17 user nova-compute[72818]:   </devices>
Aug 17 21:28:17 user nova-compute[72818]: </domain>
Aug 17 21:28:17 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:28:17 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Instance destroyed successfully.
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:28:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] No VIF found with MAC fa:16:3e:4f:f9:56, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:28:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for d54920e2-56cf-4c58-b66a-a454470c57d6 due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 21:28:22 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307702.5820682, d54920e2-56cf-4c58-b66a-a454470c57d6 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:28:22 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] VM Resumed (Lifecycle Event)
Aug 17 21:28:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-41b7a7e3-5907-40b5-98ca-1e44543e2ae4 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:28:22 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 21:28:22 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307702.5850453, d54920e2-56cf-4c58-b66a-a454470c57d6 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:28:22 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] VM Started (Lifecycle Event)
Aug 17 21:28:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:28:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:28:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:23 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:28:23 user nova-compute[72818]: INFO nova.compute.claims [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Claim successful on node user
Aug 17 21:28:24 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-3ac0d507-5fbf-41c5-913d-15fcf2f2cd6e req-50b15109-3e72-4569-b8d2-92258b0aabcf service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3ac0d507-5fbf-41c5-913d-15fcf2f2cd6e req-50b15109-3e72-4569-b8d2-92258b0aabcf service nova] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3ac0d507-5fbf-41c5-913d-15fcf2f2cd6e req-50b15109-3e72-4569-b8d2-92258b0aabcf service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3ac0d507-5fbf-41c5-913d-15fcf2f2cd6e req-50b15109-3e72-4569-b8d2-92258b0aabcf service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-3ac0d507-5fbf-41c5-913d-15fcf2f2cd6e req-50b15109-3e72-4569-b8d2-92258b0aabcf service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] No waiting events found dispatching network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:24 user nova-compute[72818]: WARNING nova.compute.manager [req-3ac0d507-5fbf-41c5-913d-15fcf2f2cd6e req-50b15109-3e72-4569-b8d2-92258b0aabcf service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received unexpected event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac for instance with vm_state rescued and task_state None.
Aug 17 21:28:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:28:24 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:28:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG nova.policy [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c80d8eb201914d10b31bb83b4a37b326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918dc1308241a78b063ebd3c655ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:28:24 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Creating image(s)
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "/opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "/opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.208s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.227s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk 1073741824" returned: 0 in 0.086s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Successfully created port: 758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.246s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Cannot resize image /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'migration_context' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Ensure instance console log exists: /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Successfully updated port: 758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquired lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-6c3f8fab-19c9-44ec-852f-5f723383ac4a req-c3baf43c-8cde-4030-b47b-6a24b622d4ee service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-changed-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-6c3f8fab-19c9-44ec-852f-5f723383ac4a req-c3baf43c-8cde-4030-b47b-6a24b622d4ee service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Refreshing instance network info cache due to event network-changed-758c519d-4502-4a83-9900-5cdfbc22c4f3. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c3f8fab-19c9-44ec-852f-5f723383ac4a req-c3baf43c-8cde-4030-b47b-6a24b622d4ee service nova] Acquiring lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-61d8827d-41e4-4494-a5f9-a49e24ac9ab9 req-49c1a076-4608-44fd-8ea2-6464a101d081 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-61d8827d-41e4-4494-a5f9-a49e24ac9ab9 req-49c1a076-4608-44fd-8ea2-6464a101d081 service nova] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-61d8827d-41e4-4494-a5f9-a49e24ac9ab9 req-49c1a076-4608-44fd-8ea2-6464a101d081 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-61d8827d-41e4-4494-a5f9-a49e24ac9ab9 req-49c1a076-4608-44fd-8ea2-6464a101d081 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-61d8827d-41e4-4494-a5f9-a49e24ac9ab9 req-49c1a076-4608-44fd-8ea2-6464a101d081 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] No waiting events found dispatching network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:26 user nova-compute[72818]: WARNING nova.compute.manager [req-61d8827d-41e4-4494-a5f9-a49e24ac9ab9 req-49c1a076-4608-44fd-8ea2-6464a101d081 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received unexpected event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac for instance with vm_state rescued and task_state None.
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updating instance_info_cache with network_info: [{"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Releasing lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Instance network_info: |[{"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c3f8fab-19c9-44ec-852f-5f723383ac4a req-c3baf43c-8cde-4030-b47b-6a24b622d4ee service nova] Acquired lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-6c3f8fab-19c9-44ec-852f-5f723383ac4a req-c3baf43c-8cde-4030-b47b-6a24b622d4ee service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Refreshing network info cache for port 758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Start _get_guest_xml network_info=[{"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:28:26 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:28:26 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1442683799',display_name='tempest-ServerStableDeviceRescueTest-server-1442683799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1442683799',id=30,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDwLSGxEukk9sEy04Wrk8OIVuJSzGsPocTfFTy++b8WWPbcEy1LQL4FEUeGxaiUAG+1gM+BfsW0ECiGjCjRoh2wxosjr/MhkzqugFjj2zenjFJHhT+ObJLdTBPH/Erxzw==',key_name='tempest-keypair-286024332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40918dc1308241a78b063ebd3c655ab4',ramdisk_id='',reservation_id='r-bflev6ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-749852486',owner_user_name='tempest-ServerStableDeviceRescueTest-749852486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:28:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c80d8eb201914d10b31bb83b4a37b326',uuid=1a747a16-45b2-4d60-aad0-f8bfbc7b0c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Converting VIF {"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6c:07,bridge_name='br-int',has_traffic_filtering=True,id=758c519d-4502-4a83-9900-5cdfbc22c4f3,network=Network(763d2138-168e-4f11-823a-4167572838f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c519d-45') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:28:26 user nova-compute[72818]:   <uuid>1a747a16-45b2-4d60-aad0-f8bfbc7b0c41</uuid>
Aug 17 21:28:26 user nova-compute[72818]:   <name>instance-0000001e</name>
Aug 17 21:28:26 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:28:26 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:28:26 user nova-compute[72818]:   <metadata>
Aug 17 21:28:26 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:28:26 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:28:26 user nova-compute[72818]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1442683799</nova:name>
Aug 17 21:28:26 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:28:26</nova:creationTime>
Aug 17 21:28:26 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:28:26 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:28:26 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:28:26 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:28:26 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:28:26 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:28:26 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:28:26 user nova-compute[72818]:       <nova:owner>
Aug 17 21:28:26 user nova-compute[72818]:         <nova:user uuid="c80d8eb201914d10b31bb83b4a37b326">tempest-ServerStableDeviceRescueTest-749852486-project-member</nova:user>
Aug 17 21:28:26 user nova-compute[72818]:         <nova:project uuid="40918dc1308241a78b063ebd3c655ab4">tempest-ServerStableDeviceRescueTest-749852486</nova:project>
Aug 17 21:28:26 user nova-compute[72818]:       </nova:owner>
Aug 17 21:28:26 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:28:26 user nova-compute[72818]:       <nova:ports>
Aug 17 21:28:26 user nova-compute[72818]:         <nova:port uuid="758c519d-4502-4a83-9900-5cdfbc22c4f3">
Aug 17 21:28:26 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 21:28:26 user nova-compute[72818]:         </nova:port>
Aug 17 21:28:26 user nova-compute[72818]:       </nova:ports>
Aug 17 21:28:26 user nova-compute[72818]:     </nova:instance>
Aug 17 21:28:26 user nova-compute[72818]:   </metadata>
Aug 17 21:28:26 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:28:26 user nova-compute[72818]:     <system>
Aug 17 21:28:26 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:28:26 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:28:26 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:28:26 user nova-compute[72818]:       <entry name="serial">1a747a16-45b2-4d60-aad0-f8bfbc7b0c41</entry>
Aug 17 21:28:26 user nova-compute[72818]:       <entry name="uuid">1a747a16-45b2-4d60-aad0-f8bfbc7b0c41</entry>
Aug 17 21:28:26 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:28:26 user nova-compute[72818]:     </system>
Aug 17 21:28:26 user nova-compute[72818]:   </sysinfo>
Aug 17 21:28:26 user nova-compute[72818]:   <os>
Aug 17 21:28:26 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:28:26 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:28:26 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:28:26 user nova-compute[72818]:   </os>
Aug 17 21:28:26 user nova-compute[72818]:   <features>
Aug 17 21:28:26 user nova-compute[72818]:     <acpi/>
Aug 17 21:28:26 user nova-compute[72818]:     <apic/>
Aug 17 21:28:26 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:28:26 user nova-compute[72818]:   </features>
Aug 17 21:28:26 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:28:26 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:28:26 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:28:26 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:28:26 user nova-compute[72818]:   </clock>
Aug 17 21:28:26 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:28:26 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:28:26 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:28:26 user nova-compute[72818]:   </cpu>
Aug 17 21:28:26 user nova-compute[72818]:   <devices>
Aug 17 21:28:26 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:28:26 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:28:26 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk"/>
Aug 17 21:28:26 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:28:26 user nova-compute[72818]:     </disk>
Aug 17 21:28:26 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:28:26 user nova-compute[72818]:       <mac address="fa:16:3e:d3:6c:07"/>
Aug 17 21:28:26 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:28:26 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:28:26 user nova-compute[72818]:       <target dev="tap758c519d-45"/>
Aug 17 21:28:26 user nova-compute[72818]:     </interface>
Aug 17 21:28:26 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:28:26 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/console.log" append="off"/>
Aug 17 21:28:26 user nova-compute[72818]:     </serial>
Aug 17 21:28:26 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:28:26 user nova-compute[72818]:     <video>
Aug 17 21:28:26 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:28:26 user nova-compute[72818]:     </video>
Aug 17 21:28:26 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:28:26 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:28:26 user nova-compute[72818]:     </rng>
Aug 17 21:28:26 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:28:26 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:28:26 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:28:26 user nova-compute[72818]:     </memballoon>
Aug 17 21:28:26 user nova-compute[72818]:   </devices>
Aug 17 21:28:26 user nova-compute[72818]: </domain>
Aug 17 21:28:26 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1442683799',display_name='tempest-ServerStableDeviceRescueTest-server-1442683799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1442683799',id=30,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDwLSGxEukk9sEy04Wrk8OIVuJSzGsPocTfFTy++b8WWPbcEy1LQL4FEUeGxaiUAG+1gM+BfsW0ECiGjCjRoh2wxosjr/MhkzqugFjj2zenjFJHhT+ObJLdTBPH/Erxzw==',key_name='tempest-keypair-286024332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40918dc1308241a78b063ebd3c655ab4',ramdisk_id='',reservation_id='r-bflev6ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-749852486',owner_user_name='tempest-ServerStableDeviceRescueTest-749852486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:28:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c80d8eb201914d10b31bb83b4a37b326',uuid=1a747a16-45b2-4d60-aad0-f8bfbc7b0c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Converting VIF {"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6c:07,bridge_name='br-int',has_traffic_filtering=True,id=758c519d-4502-4a83-9900-5cdfbc22c4f3,network=Network(763d2138-168e-4f11-823a-4167572838f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c519d-45') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG os_vif [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6c:07,bridge_name='br-int',has_traffic_filtering=True,id=758c519d-4502-4a83-9900-5cdfbc22c4f3,network=Network(763d2138-168e-4f11-823a-4167572838f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c519d-45') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap758c519d-45, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap758c519d-45, col_values=(('external_ids', {'iface-id': '758c519d-4502-4a83-9900-5cdfbc22c4f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:6c:07', 'vm-uuid': '1a747a16-45b2-4d60-aad0-f8bfbc7b0c41'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:26 user nova-compute[72818]: INFO os_vif [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6c:07,bridge_name='br-int',has_traffic_filtering=True,id=758c519d-4502-4a83-9900-5cdfbc22c4f3,network=Network(763d2138-168e-4f11-823a-4167572838f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c519d-45')
Aug 17 21:28:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:28:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] No VIF found with MAC fa:16:3e:d3:6c:07, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:28:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-6c3f8fab-19c9-44ec-852f-5f723383ac4a req-c3baf43c-8cde-4030-b47b-6a24b622d4ee service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updated VIF entry in instance network info cache for port 758c519d-4502-4a83-9900-5cdfbc22c4f3. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:28:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-6c3f8fab-19c9-44ec-852f-5f723383ac4a req-c3baf43c-8cde-4030-b47b-6a24b622d4ee service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updating instance_info_cache with network_info: [{"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:28:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c3f8fab-19c9-44ec-852f-5f723383ac4a req-c3baf43c-8cde-4030-b47b-6a24b622d4ee service nova] Releasing lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:28:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-eb28d2b3-c654-4069-91f6-2c6075eb5ce4 req-c198010e-ff37-4a00-ba50-979e642c64c3 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-eb28d2b3-c654-4069-91f6-2c6075eb5ce4 req-c198010e-ff37-4a00-ba50-979e642c64c3 service nova] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-eb28d2b3-c654-4069-91f6-2c6075eb5ce4 req-c198010e-ff37-4a00-ba50-979e642c64c3 service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-eb28d2b3-c654-4069-91f6-2c6075eb5ce4 req-c198010e-ff37-4a00-ba50-979e642c64c3 service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-eb28d2b3-c654-4069-91f6-2c6075eb5ce4 req-c198010e-ff37-4a00-ba50-979e642c64c3 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] No waiting events found dispatching network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:28 user nova-compute[72818]: WARNING nova.compute.manager [req-eb28d2b3-c654-4069-91f6-2c6075eb5ce4 req-c198010e-ff37-4a00-ba50-979e642c64c3 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received unexpected event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 for instance with vm_state building and task_state spawning.
Aug 17 21:28:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307710.4002197, 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:28:30 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] VM Resumed (Lifecycle Event)
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:28:30 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Instance spawned successfully.
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:28:30 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307710.4035006, 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:28:30 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] VM Started (Lifecycle Event)
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-ab7cd9fb-375e-43ab-bd7b-3455689acad5 req-1f65a40e-18d5-4d33-bd6d-c3448c95877f service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ab7cd9fb-375e-43ab-bd7b-3455689acad5 req-1f65a40e-18d5-4d33-bd6d-c3448c95877f service nova] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ab7cd9fb-375e-43ab-bd7b-3455689acad5 req-1f65a40e-18d5-4d33-bd6d-c3448c95877f service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ab7cd9fb-375e-43ab-bd7b-3455689acad5 req-1f65a40e-18d5-4d33-bd6d-c3448c95877f service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-ab7cd9fb-375e-43ab-bd7b-3455689acad5 req-1f65a40e-18d5-4d33-bd6d-c3448c95877f service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] No waiting events found dispatching network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:30 user nova-compute[72818]: WARNING nova.compute.manager [req-ab7cd9fb-375e-43ab-bd7b-3455689acad5 req-1f65a40e-18d5-4d33-bd6d-c3448c95877f service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received unexpected event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 for instance with vm_state building and task_state spawning.
Aug 17 21:28:30 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:28:30 user nova-compute[72818]: INFO nova.compute.manager [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 17 21:28:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:30 user nova-compute[72818]: INFO nova.compute.manager [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Took 7.07 seconds to build instance.
Aug 17 21:28:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b687ed42-18aa-4510-b81b-2c0b8fa6b219 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.170s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "8b6e6587-fddd-45bf-b295-e7eaace49948" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:40 user nova-compute[72818]: INFO nova.compute.manager [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Terminating instance
Aug 17 21:28:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-5bbd50d5-afc9-4374-8352-62b9ad7a2fba req-da2402ff-5169-4d33-b376-869e0f3a432f service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Received event network-vif-unplugged-c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5bbd50d5-afc9-4374-8352-62b9ad7a2fba req-da2402ff-5169-4d33-b376-869e0f3a432f service nova] Acquiring lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5bbd50d5-afc9-4374-8352-62b9ad7a2fba req-da2402ff-5169-4d33-b376-869e0f3a432f service nova] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5bbd50d5-afc9-4374-8352-62b9ad7a2fba req-da2402ff-5169-4d33-b376-869e0f3a432f service nova] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-5bbd50d5-afc9-4374-8352-62b9ad7a2fba req-da2402ff-5169-4d33-b376-869e0f3a432f service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] No waiting events found dispatching network-vif-unplugged-c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-5bbd50d5-afc9-4374-8352-62b9ad7a2fba req-da2402ff-5169-4d33-b376-869e0f3a432f service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Received event network-vif-unplugged-c5fffdf3-3301-4b5b-b513-36c11c849eb4 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:28:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Instance destroyed successfully.
Aug 17 21:28:41 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lazy-loading 'resources' on Instance uuid 8b6e6587-fddd-45bf-b295-e7eaace49948 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1463889647',display_name='tempest-TestVolumeBootPattern-server-1463889647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1463889647',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:27:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-jwy0r6x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:27:15Z,user_data=None,user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=8b6e6587-fddd-45bf-b295-e7eaace49948,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "address": "fa:16:3e:69:a2:08", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fffdf3-33", "ovs_interfaceid": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "address": "fa:16:3e:69:a2:08", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fffdf3-33", "ovs_interfaceid": "c5fffdf3-3301-4b5b-b513-36c11c849eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=c5fffdf3-3301-4b5b-b513-36c11c849eb4,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fffdf3-33') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_vif [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=c5fffdf3-3301-4b5b-b513-36c11c849eb4,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fffdf3-33') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5fffdf3-33, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:41 user nova-compute[72818]: INFO os_vif [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a2:08,bridge_name='br-int',has_traffic_filtering=True,id=c5fffdf3-3301-4b5b-b513-36c11c849eb4,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fffdf3-33')
Aug 17 21:28:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEGZvmFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:28:41 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5f5ed6-0cdb-4a31-871e-f9d741fb6fb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fca160-6cb6-47e1-99ac-52210e4282af]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:28:41 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:28:41 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:28:41 user nova-compute[72818]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:28:41 user nova-compute[72818]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 (non-flash)
Aug 17 21:28:41 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:28:41 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:28:41 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:28:41 user nova-compute[72818]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:28:41 user nova-compute[72818]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 (non-flash)
Aug 17 21:28:41 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04e3f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1'): ({'sde'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Removing single pathed devices sde {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f646f54-93cb-4062-a802-a95bf5eaa245]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8b11b9-9c09-46c5-bbe6-fc37efdb765f]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flushing IO for device /dev/sde {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f464db14-40a4-4a31-b823-accb31937c25]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb453c1-3224-4051-8642-2e4e0cf2ed21]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] SCSI volumes sde have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a9f1cd05', '/dev/disk/by-id/scsi-23439303766333331', '/dev/disk/by-id/scsi-1SCST_BIOa9f1cd05-4907f3312a7f8842') {{(pid=83620) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8673bcfe-92d1-4fd6-81d4-2275375ca398]: (4, None) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e407dd8e-d55f-4684-a87f-616707089dee]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-e27fdc00-42a5-4c7f-8dc1-525323279a72 req-d1926791-f69f-428f-9610-c476b89303fe service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-changed-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-e27fdc00-42a5-4c7f-8dc1-525323279a72 req-d1926791-f69f-428f-9610-c476b89303fe service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Refreshing instance network info cache due to event network-changed-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e27fdc00-42a5-4c7f-8dc1-525323279a72 req-d1926791-f69f-428f-9610-c476b89303fe service nova] Acquiring lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e27fdc00-42a5-4c7f-8dc1-525323279a72 req-d1926791-f69f-428f-9610-c476b89303fe service nova] Acquired lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG nova.network.neutron [req-e27fdc00-42a5-4c7f-8dc1-525323279a72 req-d1926791-f69f-428f-9610-c476b89303fe service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Refreshing network info cache for port 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4953d1a-e9ca-4bae-b683-68456ec5690f]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1, portal: 172.16.0.220,3260]
Aug 17 21:28:41 user nova-compute[72818]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1, portal: 172.16.0.220,3260] successful.
Aug 17 21:28:41 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e33f91eb-8139-4b53-a459-6fc1b78652a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c58733e-e22e-4deb-82f2-0ae36c2762f2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== disconnect_volume: return (417ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:28:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:28:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Deleting instance files /opt/stack/data/nova/instances/8b6e6587-fddd-45bf-b295-e7eaace49948_del
Aug 17 21:28:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Deletion of /opt/stack/data/nova/instances/8b6e6587-fddd-45bf-b295-e7eaace49948_del complete
Aug 17 21:28:41 user nova-compute[72818]: INFO nova.compute.manager [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Terminating instance
Aug 17 21:28:41 user nova-compute[72818]: DEBUG nova.compute.manager [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:28:42 user nova-compute[72818]: INFO nova.compute.manager [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Took 1.40 seconds to destroy the instance on the hypervisor.
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG nova.network.neutron [req-e27fdc00-42a5-4c7f-8dc1-525323279a72 req-d1926791-f69f-428f-9610-c476b89303fe service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updated VIF entry in instance network info cache for port 11b6e8dd-b7be-4017-bf4a-1baf62da4e5a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG nova.network.neutron [req-e27fdc00-42a5-4c7f-8dc1-525323279a72 req-d1926791-f69f-428f-9610-c476b89303fe service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updating instance_info_cache with network_info: [{"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e27fdc00-42a5-4c7f-8dc1-525323279a72 req-d1926791-f69f-428f-9610-c476b89303fe service nova] Releasing lock "refresh_cache-92f865e1-d261-47e3-a64d-dc7bc6e7a93f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:28:42 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Instance destroyed successfully.
Aug 17 21:28:42 user nova-compute[72818]: DEBUG nova.objects.instance [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lazy-loading 'resources' on Instance uuid 92f865e1-d261-47e3-a64d-dc7bc6e7a93f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-722415076',display_name='tempest-TestShelveInstance-server-722415076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-722415076',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbPQv3z46gQnD4kxEjmUMxOixZmn4RDSrvj8X5ykYzwAOh9lGPQIyUa74vFa9YDsWg3lQ+Ldy4b84xgODAEdHo+3ZxHtuJ0Eqiefl9WxOeAXl0smQQSiJMBvhsgbOQE/Q==',key_name='tempest-TestShelveInstance-1267606421',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:27:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30ddbaf2a03d4f14b7b7ca0096d05c4a',ramdisk_id='',reservation_id='r-k1p3u19l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-15245591',owner_user_name='tempest-TestShelveInstance-15245591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:27:12Z,user_data=None,user_id='859bd4e053cd4fc6b7e6633afb107758',uuid=92f865e1-d261-47e3-a64d-dc7bc6e7a93f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Converting VIF {"id": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "address": "fa:16:3e:fb:b2:1a", "network": {"id": "fcc9665f-a84b-4bb3-8477-9840e373de35", "bridge": "br-int", "label": "tempest-TestShelveInstance-335442975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30ddbaf2a03d4f14b7b7ca0096d05c4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b6e8dd-b7", "ovs_interfaceid": "11b6e8dd-b7be-4017-bf4a-1baf62da4e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG os_vif [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11b6e8dd-b7, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:28:42 user nova-compute[72818]: INFO os_vif [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=11b6e8dd-b7be-4017-bf4a-1baf62da4e5a,network=Network(fcc9665f-a84b-4bb3-8477-9840e373de35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b6e8dd-b7')
Aug 17 21:28:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZVeHRuyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:28:42 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:28:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9273411e-ca75-4863-aad6-13199427188f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[30375327-6111-47ce-9c4c-365385708ba5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:28:42 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:28:42 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:28:42 user nova-compute[72818]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:28:42 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:28:42 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:28:42 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:28:42 user nova-compute[72818]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f (non-flash)
Aug 17 21:28:42 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f28527010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2152b940-a752-4637-a89b-597dda7c4476]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-53ee9c8e-ae12-4931-8791-9bee1951aeda req-34f865ba-d58d-4950-876c-0052615a9fff service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Received event network-vif-plugged-c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-53ee9c8e-ae12-4931-8791-9bee1951aeda req-34f865ba-d58d-4950-876c-0052615a9fff service nova] Acquiring lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-53ee9c8e-ae12-4931-8791-9bee1951aeda req-34f865ba-d58d-4950-876c-0052615a9fff service nova] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-53ee9c8e-ae12-4931-8791-9bee1951aeda req-34f865ba-d58d-4950-876c-0052615a9fff service nova] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-53ee9c8e-ae12-4931-8791-9bee1951aeda req-34f865ba-d58d-4950-876c-0052615a9fff service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] No waiting events found dispatching network-vif-plugged-c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:42 user nova-compute[72818]: WARNING nova.compute.manager [req-53ee9c8e-ae12-4931-8791-9bee1951aeda req-34f865ba-d58d-4950-876c-0052615a9fff service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Received unexpected event network-vif-plugged-c5fffdf3-3301-4b5b-b513-36c11c849eb4 for instance with vm_state active and task_state deleting.
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d505363-324e-43ba-8b43-43af59d7803f]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:28:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cadcf9-91c6-4e17-8248-77447551f802]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfbe348-fd8d-4815-9ca6-bac5f140828a]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6e9e63-44a6-4b90-b5cf-de1a37052c49]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7cc4de-3636-4999-9368-6e562326bf7f]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260]
Aug 17 21:28:43 user nova-compute[72818]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f, portal: 172.16.0.220,3260] successful.
Aug 17 21:28:43 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a67fd5-dd50-4a87-a413-fec308eb6f2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe094ee-1e78-4d3a-b822-b6cbaef58b8b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] <== disconnect_volume: return (356ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:28:43 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Deleting instance files /opt/stack/data/nova/instances/92f865e1-d261-47e3-a64d-dc7bc6e7a93f_del
Aug 17 21:28:43 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Deletion of /opt/stack/data/nova/instances/92f865e1-d261-47e3-a64d-dc7bc6e7a93f_del complete
Aug 17 21:28:43 user nova-compute[72818]: INFO nova.compute.manager [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:28:43 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Took 1.36 seconds to deallocate network for instance.
Aug 17 21:28:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-vif-unplugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] No waiting events found dispatching network-vif-unplugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-vif-unplugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:28:44 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Received event network-vif-deleted-c5fffdf3-3301-4b5b-b513-36c11c849eb4 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:44 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] Acquiring lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:44 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] No waiting events found dispatching network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:28:44 user nova-compute[72818]: WARNING nova.compute.manager [req-d2cc912e-a33f-491b-89b3-2482e11ef0cb req-b6793efd-5a06-4df5-a3de-393893df9641 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received unexpected event network-vif-plugged-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a for instance with vm_state active and task_state deleting.
Aug 17 21:28:44 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:28:44 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Took 0.86 seconds to deallocate network for instance.
Aug 17 21:28:44 user nova-compute[72818]: INFO nova.compute.manager [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Took 0.90 seconds to detach 1 volumes for instance.
Aug 17 21:28:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Deleting volume: e33f91eb-8139-4b53-a459-6fc1b78652a1 {{(pid=72818) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 21:28:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:44 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:28:44 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:28:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:44 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Deleted allocations for instance 8b6e6587-fddd-45bf-b295-e7eaace49948
Aug 17 21:28:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5097155-dab8-461d-bce7-a928dc7da7dc tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "8b6e6587-fddd-45bf-b295-e7eaace49948" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.374s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-9988ac4f-1020-483d-b704-5063034f355f req-a7206024-cede-4491-999b-bdc10799ebe6 service nova] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Received event network-vif-deleted-11b6e8dd-b7be-4017-bf4a-1baf62da4e5a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:28:45 user nova-compute[72818]: INFO nova.compute.manager [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Took 0.86 seconds to detach 1 volumes for instance.
Aug 17 21:28:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Deleting volume: c4a67fd5-dd50-4a87-a413-fec308eb6f2f {{(pid=72818) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 21:28:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:28:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:28:45 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:28:45 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:28:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:45 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Deleted allocations for instance 92f865e1-d261-47e3-a64d-dc7bc6e7a93f
Aug 17 21:28:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-999b528f-a22a-424c-8fae-bd094fd60d6c tempest-TestShelveInstance-15245591 tempest-TestShelveInstance-15245591-project-member] Lock "92f865e1-d261-47e3-a64d-dc7bc6e7a93f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.707s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:28:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:55 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:28:56 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307721.4334307, 8b6e6587-fddd-45bf-b295-e7eaace49948 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:28:56 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] VM Stopped (Lifecycle Event)
Aug 17 21:28:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-47655e0a-9070-48a7-af3f-390108e44fc4 None None] [instance: 8b6e6587-fddd-45bf-b295-e7eaace49948] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:57 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307722.8155239, 92f865e1-d261-47e3-a64d-dc7bc6e7a93f => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:28:57 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] VM Stopped (Lifecycle Event)
Aug 17 21:28:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-488aaefa-20b3-46ad-a800-0d1511a37b8e None None] [instance: 92f865e1-d261-47e3-a64d-dc7bc6e7a93f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:28:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:28:58 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:28:58 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:28:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:28:59 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:28:59 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 21:28:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:29:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:01 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:29:02 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:29:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:29:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:29:02 user nova-compute[72818]: INFO nova.compute.manager [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Detaching volume 3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70
Aug 17 21:29:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:02 user nova-compute[72818]: INFO nova.virt.block_device [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Attempting to driver detach volume 3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 from mountpoint /dev/vdb
Aug 17 21:29:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Attempting to detach device vdb from instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:29:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:29:02 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:29:02 user nova-compute[72818]:   <source dev="/dev/sdd"/>
Aug 17 21:29:02 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:29:02 user nova-compute[72818]:   <serial>3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70</serial>
Aug 17 21:29:02 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 21:29:02 user nova-compute[72818]: </disk>
Aug 17 21:29:02 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:29:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Successfully detached device vdb from instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 from the persistent domain config.
Aug 17 21:29:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:29:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:29:02 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:29:02 user nova-compute[72818]:   <source dev="/dev/sdd"/>
Aug 17 21:29:02 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:29:02 user nova-compute[72818]:   <serial>3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70</serial>
Aug 17 21:29:02 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 21:29:02 user nova-compute[72818]: </disk>
Aug 17 21:29:02 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692307743.3880873, 8ab794f2-ef30-4524-8eea-224873d6f0b5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:29:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Successfully detached device vdb from instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 from the live domain config.
Aug 17 21:29:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRFeihWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:29:03 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebf4f06-c64c-4aa2-ad5a-3697535b93b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa11adef-7900-4377-af11-b63c3931279d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:29:03 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:29:03 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:29:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:29:03 user nova-compute[72818]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 (non-flash)
Aug 17 21:29:03 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:29:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04e66560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70'): ({'sdd'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Removing single pathed devices sdd {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cce0bbf-f964-4175-9e12-9a9e37cf934f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[180bb01b-c8df-4f6f-b249-60b09b567f07]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Flushing IO for device /dev/sdd {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8de48e-1c09-421d-b9b3-922fbbc84182]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d35397-d0d5-4b1f-a3f6-bd151828f528]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1d3079-b164-4cec-b221-3319f6caf187]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e64c773-f509-4c89-92ba-64fbe077b3e6]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260]
Aug 17 21:29:03 user nova-compute[72818]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70, portal: 172.16.0.220,3260] successful.
Aug 17 21:29:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae7cd6a-c8be-49dc-97c2-f8222e9e9e70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93cbd00-f443-4375-b6f8-dc38e12aef13]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] <== disconnect_volume: return (292ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:29:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:29:04 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'flavor' on Instance uuid 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:29:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7595a3fe-d920-4f61-a1ca-74ea2f8d64f5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.687s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:29:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:29:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:29:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:29:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:29:04 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:29:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:29:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:29:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:29:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:29:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7044MB free_disk=25.15338897705078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:29:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:29:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 774642dc-1888-4f4e-9485-b6dfe7ad6a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 6c46354a-2316-4703-b7fb-431fa37df1ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8ab794f2-ef30-4524-8eea-224873d6f0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance d54920e2-56cf-4c58-b66a-a454470c57d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e15761ac-028d-40a9-931d-51ef8b77c1cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:29:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:29:12 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:29:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:29:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:29:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:29:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:29:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-5fe08cb7-18aa-4739-9aa8-9a6b1aa82004 req-1d24fcda-70fc-4099-a6fc-36000042dd88 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-changed-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-5fe08cb7-18aa-4739-9aa8-9a6b1aa82004 req-1d24fcda-70fc-4099-a6fc-36000042dd88 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Refreshing instance network info cache due to event network-changed-ff979858-3d61-4234-b7fc-f3f738f6e640. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5fe08cb7-18aa-4739-9aa8-9a6b1aa82004 req-1d24fcda-70fc-4099-a6fc-36000042dd88 service nova] Acquiring lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5fe08cb7-18aa-4739-9aa8-9a6b1aa82004 req-1d24fcda-70fc-4099-a6fc-36000042dd88 service nova] Acquired lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG nova.network.neutron [req-5fe08cb7-18aa-4739-9aa8-9a6b1aa82004 req-1d24fcda-70fc-4099-a6fc-36000042dd88 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Refreshing network info cache for port ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG nova.objects.instance [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'flavor' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:29:51 user nova-compute[72818]: INFO nova.compute.manager [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Attaching volume 8fc8ad73-7ddc-4889-9721-2246440ad0f3 to /dev/vdb
Aug 17 21:29:51 user nova-compute[72818]: DEBUG nova.network.neutron [req-5fe08cb7-18aa-4739-9aa8-9a6b1aa82004 req-1d24fcda-70fc-4099-a6fc-36000042dd88 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updated VIF entry in instance network info cache for port ff979858-3d61-4234-b7fc-f3f738f6e640. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG nova.network.neutron [req-5fe08cb7-18aa-4739-9aa8-9a6b1aa82004 req-1d24fcda-70fc-4099-a6fc-36000042dd88 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updating instance_info_cache with network_info: [{"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5fe08cb7-18aa-4739-9aa8-9a6b1aa82004 req-1d24fcda-70fc-4099-a6fc-36000042dd88 service nova] Releasing lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG os_brick.utils [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6612482-3437-4e02-9822-60b8e663dcbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad0abb7-60a5-4afd-89d6-13929659ab89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00e18a7-f43c-4ec8-8cce-df43e9008522]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[572c196c-2aa4-4b72-afe2-14e611dcf9dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:29:51 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:29:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4059ef-4514-48db-9182-5ab1329ee256]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG os_brick.utils [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:29:51 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updating existing volume attachment record: 8ac93e09-38e7-419c-a802-e293669009f4 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:29:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:29:53 user nova-compute[72818]: INFO nova.compute.manager [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Terminating instance
Aug 17 21:29:53 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG nova.compute.manager [req-9689dc44-29b1-4e8f-bdcc-57069f58db31 req-c859c317-6da3-42f6-bafd-2818e1bfcd8b service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-unplugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9689dc44-29b1-4e8f-bdcc-57069f58db31 req-c859c317-6da3-42f6-bafd-2818e1bfcd8b service nova] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9689dc44-29b1-4e8f-bdcc-57069f58db31 req-c859c317-6da3-42f6-bafd-2818e1bfcd8b service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9689dc44-29b1-4e8f-bdcc-57069f58db31 req-c859c317-6da3-42f6-bafd-2818e1bfcd8b service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG nova.compute.manager [req-9689dc44-29b1-4e8f-bdcc-57069f58db31 req-c859c317-6da3-42f6-bafd-2818e1bfcd8b service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] No waiting events found dispatching network-vif-unplugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG nova.compute.manager [req-9689dc44-29b1-4e8f-bdcc-57069f58db31 req-c859c317-6da3-42f6-bafd-2818e1bfcd8b service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-unplugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:29:53 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Instance destroyed successfully.
Aug 17 21:29:53 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'resources' on Instance uuid 8ab794f2-ef30-4524-8eea-224873d6f0b5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1842332389',display_name='tempest-ServerActionsTestOtherA-server-1272518972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1842332389',id=25,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLocLU8TRDAiLi3GdKktq0nWqdk7D1keSlsLXc1XBv8DJ5eY9kzsxQScXcrArgHMHu1A1J4D/TdCnI8XhIYNw2UvB+RykgPVyRzvdlRj00o3UKrPopaD5xejUX+15fusg==',key_name='tempest-keypair-904493785',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:26:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-igol0v2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:26:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=8ab794f2-ef30-4524-8eea-224873d6f0b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "address": "fa:16:3e:61:46:e5", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9576b57c-48", "ovs_interfaceid": "9576b57c-48c9-4fe8-bfc8-17876b941e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG os_vif [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9576b57c-48, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:29:53 user nova-compute[72818]: INFO os_vif [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:46:e5,bridge_name='br-int',has_traffic_filtering=True,id=9576b57c-48c9-4fe8-bfc8-17876b941e67,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9576b57c-48')
Aug 17 21:29:53 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Deleting instance files /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5_del
Aug 17 21:29:53 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Deletion of /opt/stack/data/nova/instances/8ab794f2-ef30-4524-8eea-224873d6f0b5_del complete
Aug 17 21:29:54 user nova-compute[72818]: INFO nova.compute.manager [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 21:29:54 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:29:54 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:29:54 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:29:55 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Took 1.30 seconds to deallocate network for instance.
Aug 17 21:29:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-d0aefa3d-1279-4abc-9682-eba13ff786c9 req-75193177-0749-42a1-95f2-7fc2aa44c0e9 service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-deleted-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:29:55 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Deleted allocations for instance 8ab794f2-ef30-4524-8eea-224873d6f0b5
Aug 17 21:29:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] Acquiring lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] No waiting events found dispatching network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:29:55 user nova-compute[72818]: WARNING nova.compute.manager [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Received unexpected event network-vif-plugged-9576b57c-48c9-4fe8-bfc8-17876b941e67 for instance with vm_state deleted and task_state None.
Aug 17 21:29:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-changed-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Refreshing instance network info cache due to event network-changed-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] Acquiring lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] Acquired lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:29:55 user nova-compute[72818]: DEBUG nova.network.neutron [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Refreshing network info cache for port 5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:29:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f756bb50-58ea-4c15-bc52-446ad93155eb tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "8ab794f2-ef30-4524-8eea-224873d6f0b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.855s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:29:56 user nova-compute[72818]: DEBUG nova.network.neutron [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Updated VIF entry in instance network info cache for port 5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:29:56 user nova-compute[72818]: DEBUG nova.network.neutron [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Updating instance_info_cache with network_info: [{"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:29:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9bf6aa49-269e-4ade-b6da-81e9a0ed2f9b req-fd51753f-e06b-430d-97af-2ce36768dd0c service nova] Releasing lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:29:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:29:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:29:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:29:59 user nova-compute[72818]: DEBUG nova.objects.instance [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:29:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:29:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:29:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:00 user nova-compute[72818]: INFO nova.compute.manager [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Attaching volume 28aedce7-4232-412f-ba04-bd66b329c60a to /dev/vdb
Aug 17 21:30:00 user nova-compute[72818]: DEBUG os_brick.utils [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6545dee2-5896-496a-b282-78c8c6f12c83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5413a6c5-917c-4aa1-aa41-4527e5a3af1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac58a4cd-dbdc-4340-8e95-5b3ee43471de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[528d3235-ba51-4b17-b241-b3bf99467cf3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:30:00 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ca03e8-2dbc-44c7-aed5-8050e0bd0417]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG os_brick.utils [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Updating existing volume attachment record: be8c0ab2-a8b8-48df-bd0d-26cb18d5733c {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:30:00 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid b9a0da7f-47b4-467f-944d-49adac671a06 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:01 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Updating instance_info_cache with network_info: [{"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:30:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-b9a0da7f-47b4-467f-944d-49adac671a06" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:30:01 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:30:01 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:30:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:02 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:03 user nova-compute[72818]: INFO nova.compute.manager [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Terminating instance
Aug 17 21:30:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-2247d084-898a-4566-882a-7b5cedde7d19 req-844aac64-b593-45a8-9a41-d8dcf9206e9f service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Received event network-vif-unplugged-3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2247d084-898a-4566-882a-7b5cedde7d19 req-844aac64-b593-45a8-9a41-d8dcf9206e9f service nova] Acquiring lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2247d084-898a-4566-882a-7b5cedde7d19 req-844aac64-b593-45a8-9a41-d8dcf9206e9f service nova] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2247d084-898a-4566-882a-7b5cedde7d19 req-844aac64-b593-45a8-9a41-d8dcf9206e9f service nova] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-2247d084-898a-4566-882a-7b5cedde7d19 req-844aac64-b593-45a8-9a41-d8dcf9206e9f service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] No waiting events found dispatching network-vif-unplugged-3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-2247d084-898a-4566-882a-7b5cedde7d19 req-844aac64-b593-45a8-9a41-d8dcf9206e9f service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Received event network-vif-unplugged-3fd414a9-7626-492c-8040-bc696ba6b8d6 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hyDanOWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:30:03 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:30:03 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:30:03 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8974095e-8faa-4ad1-90ed-650f82813cd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:30:03 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20082b2-28e8-4b19-8dea-ccaf8c0d97b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3] added
Aug 17 21:30:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[714a5c0c-6c72-4fed-862c-25cc27b30a6d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:03 user nova-compute[72818]: INFO nova.compute.manager [None req-64f11f2d-f169-438c-9599-89bc8e6cac78 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Unrescuing
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-64f11f2d-f169-438c-9599-89bc8e6cac78 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "refresh_cache-d54920e2-56cf-4c58-b66a-a454470c57d6" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-64f11f2d-f169-438c-9599-89bc8e6cac78 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquired lock "refresh_cache-d54920e2-56cf-4c58-b66a-a454470c57d6" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG nova.network.neutron [None req-64f11f2d-f169-438c-9599-89bc8e6cac78 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[876ec419-e21a-4177-ad76-f1bc2f6df91b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hyDanOWl {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hyDanOWl" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6fc49e-30e7-4f3f-96e2-31697fe09d92]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hyDanOWl'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf07dc9-cc08-435f-bc9c-80853ed83d3f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c43e2f3-8272-4d6a-8da1-e2d9eb01316f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:30:03 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:30:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:30:03 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:30:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Instance destroyed successfully.
Aug 17 21:30:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lazy-loading 'resources' on Instance uuid 774642dc-1888-4f4e-9485-b6dfe7ad6a7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2031178523',display_name='tempest-ServersNegativeTestJSON-server-2031178523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2031178523',id=19,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:21:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='885c25f7a170493480c909f74b2188d1',ramdisk_id='',reservation_id='r-dawk7omz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1481471081',owner_user_name='tempest-ServersNegativeTestJSON-1481471081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:21:06Z,user_data=None,user_id='721ba7982e32474aa2516493125fbf18',uuid=774642dc-1888-4f4e-9485-b6dfe7ad6a7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "address": "fa:16:3e:32:9a:3b", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd414a9-76", "ovs_interfaceid": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Converting VIF {"id": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "address": "fa:16:3e:32:9a:3b", "network": {"id": "0547d029-5119-44ff-8d0e-31e2292d02e5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1496237125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "885c25f7a170493480c909f74b2188d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd414a9-76", "ovs_interfaceid": "3fd414a9-7626-492c-8040-bc696ba6b8d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:9a:3b,bridge_name='br-int',has_traffic_filtering=True,id=3fd414a9-7626-492c-8040-bc696ba6b8d6,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd414a9-76') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_vif [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:9a:3b,bridge_name='br-int',has_traffic_filtering=True,id=3fd414a9-7626-492c-8040-bc696ba6b8d6,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd414a9-76') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fd414a9-76, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ab2598-5155-48c6-a570-335ba179a385]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3, portal: 172.16.0.220,3260]
Aug 17 21:30:03 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3, portal: 172.16.0.220,3260] successful.
Aug 17 21:30:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:03 user nova-compute[72818]: INFO os_vif [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:9a:3b,bridge_name='br-int',has_traffic_filtering=True,id=3fd414a9-7626-492c-8040-bc696ba6b8d6,network=Network(0547d029-5119-44ff-8d0e-31e2292d02e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd414a9-76')
Aug 17 21:30:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Deleting instance files /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f_del
Aug 17 21:30:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Deletion of /opt/stack/data/nova/instances/774642dc-1888-4f4e-9485-b6dfe7ad6a7f_del complete
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae3be56-2278-44de-9a7d-b46c97be6907]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c0ca2c-7b93-474f-b511-4bfc957b333b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:30:03 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:30:03 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:30:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:30:03 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:30:03 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:30:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[631fcec0-3c4d-4a28-a510-6cf71440c68b]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:30:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hyDanOWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:30:03 user nova-compute[72818]: INFO nova.compute.manager [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 21:30:03 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG nova.network.neutron [None req-64f11f2d-f169-438c-9599-89bc8e6cac78 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Updating instance_info_cache with network_info: [{"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-64f11f2d-f169-438c-9599-89bc8e6cac78 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Releasing lock "refresh_cache-d54920e2-56cf-4c58-b66a-a454470c57d6" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG nova.objects.instance [None req-64f11f2d-f169-438c-9599-89bc8e6cac78 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'flavor' on Instance uuid d54920e2-56cf-4c58-b66a-a454470c57d6 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:30:04 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Took 0.61 seconds to deallocate network for instance.
Aug 17 21:30:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-a466146e-1427-4c80-95c6-2deb86a2ca73 req-3e6ba6df-2b79-4438-9eb9-3074decfaf84 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-unplugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a466146e-1427-4c80-95c6-2deb86a2ca73 req-3e6ba6df-2b79-4438-9eb9-3074decfaf84 service nova] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a466146e-1427-4c80-95c6-2deb86a2ca73 req-3e6ba6df-2b79-4438-9eb9-3074decfaf84 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a466146e-1427-4c80-95c6-2deb86a2ca73 req-3e6ba6df-2b79-4438-9eb9-3074decfaf84 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-a466146e-1427-4c80-95c6-2deb86a2ca73 req-3e6ba6df-2b79-4438-9eb9-3074decfaf84 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] No waiting events found dispatching network-vif-unplugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:04 user nova-compute[72818]: WARNING nova.compute.manager [req-a466146e-1427-4c80-95c6-2deb86a2ca73 req-3e6ba6df-2b79-4438-9eb9-3074decfaf84 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received unexpected event network-vif-unplugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:30:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:30:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23137366433333935', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137366433333935', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG nova.objects.instance [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'flavor' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:30:05 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:30:05 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:30:05 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:30:05 user nova-compute[72818]:   <serial>8fc8ad73-7ddc-4889-9721-2246440ad0f3</serial>
Aug 17 21:30:05 user nova-compute[72818]: </disk>
Aug 17 21:30:05 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:05 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Deleted allocations for instance 774642dc-1888-4f4e-9485-b6dfe7ad6a7f
Aug 17 21:30:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-418eda79-a5cb-45ca-8736-68c9afbb194d tempest-ServersNegativeTestJSON-1481471081 tempest-ServersNegativeTestJSON-1481471081-project-member] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.262s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-9ba8f167-dcf1-4246-81a9-328c5f365a35 req-2c62f192-56e5-4043-85a9-778c3903adfe service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Received event network-vif-plugged-3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9ba8f167-dcf1-4246-81a9-328c5f365a35 req-2c62f192-56e5-4043-85a9-778c3903adfe service nova] Acquiring lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9ba8f167-dcf1-4246-81a9-328c5f365a35 req-2c62f192-56e5-4043-85a9-778c3903adfe service nova] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9ba8f167-dcf1-4246-81a9-328c5f365a35 req-2c62f192-56e5-4043-85a9-778c3903adfe service nova] Lock "774642dc-1888-4f4e-9485-b6dfe7ad6a7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-9ba8f167-dcf1-4246-81a9-328c5f365a35 req-2c62f192-56e5-4043-85a9-778c3903adfe service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] No waiting events found dispatching network-vif-plugged-3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:05 user nova-compute[72818]: WARNING nova.compute.manager [req-9ba8f167-dcf1-4246-81a9-328c5f365a35 req-2c62f192-56e5-4043-85a9-778c3903adfe service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Received unexpected event network-vif-plugged-3fd414a9-7626-492c-8040-bc696ba6b8d6 for instance with vm_state deleted and task_state None.
Aug 17 21:30:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-9ba8f167-dcf1-4246-81a9-328c5f365a35 req-2c62f192-56e5-4043-85a9-778c3903adfe service nova] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Received event network-vif-deleted-3fd414a9-7626-492c-8040-bc696ba6b8d6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:05 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Instance destroyed successfully.
Aug 17 21:30:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No VIF found with MAC fa:16:3e:c4:d9:ba, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-faffc752-15fc-46e6-a38d-bcb17b3b1da0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.111s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:05 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:30:06 user nova-compute[72818]: INFO nova.compute.manager [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Rescuing
Aug 17 21:30:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:30:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquired lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:30:06 user nova-compute[72818]: DEBUG nova.network.neutron [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:30:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:06 user nova-compute[72818]: DEBUG nova.network.neutron [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updating instance_info_cache with network_info: [{"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:30:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-fdabbe80-f085-4d6e-bca6-c253118bba69 req-529a31ae-2eb9-4e99-8b2b-1cdd9bb25c58 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fdabbe80-f085-4d6e-bca6-c253118bba69 req-529a31ae-2eb9-4e99-8b2b-1cdd9bb25c58 service nova] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fdabbe80-f085-4d6e-bca6-c253118bba69 req-529a31ae-2eb9-4e99-8b2b-1cdd9bb25c58 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fdabbe80-f085-4d6e-bca6-c253118bba69 req-529a31ae-2eb9-4e99-8b2b-1cdd9bb25c58 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-fdabbe80-f085-4d6e-bca6-c253118bba69 req-529a31ae-2eb9-4e99-8b2b-1cdd9bb25c58 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] No waiting events found dispatching network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:06 user nova-compute[72818]: WARNING nova.compute.manager [req-fdabbe80-f085-4d6e-bca6-c253118bba69 req-529a31ae-2eb9-4e99-8b2b-1cdd9bb25c58 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received unexpected event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:30:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Releasing lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:30:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:07 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Instance destroyed successfully.
Aug 17 21:30:07 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Attempting rescue
Aug 17 21:30:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72818) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Instance directory exists: not creating {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 21:30:07 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Creating image(s)
Aug 17 21:30:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "/opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "/opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "/opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'trusted_certs' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.232s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.rescue {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.rescue" returned: 0 in 0.063s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'migration_context' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Start _get_guest_xml network_info=[{"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "vif_mac": "fa:16:3e:c4:d9:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'resources' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'numa_topology' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:08 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:30:08 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'vcpu_model' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2146804663',display_name='tempest-ServerRescueNegativeTestJSON-server-2146804663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2146804663',id=28,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV/pS7wUhm0egVv1NtGbx5/2A1E7cbIE5hKV5ijlKQsvO0xKD4ofO5CI2bFHmvs/MMU7DPVxjfa7iDVYpJ0GH7ksRIf1X2CzuVLFIO0pnHBbe6SeUNRQnv5JLq6KDzMyQ==',key_name='tempest-keypair-70771550',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f6bdddb43364e86b302c9c2e273fd44',ramdisk_id='',reservation_id='r-s734dqvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-713886303',owner_user_name='tempest-ServerRescueNegativeTestJSON-713886303-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa40080d9842b1a4f6a3e041b5d123',uuid=e15761ac-028d-40a9-931d-51ef8b77c1cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "vif_mac": "fa:16:3e:c4:d9:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converting VIF {"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "vif_mac": "fa:16:3e:c4:d9:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:d9:ba,bridge_name='br-int',has_traffic_filtering=True,id=ff979858-3d61-4234-b7fc-f3f738f6e640,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff979858-3d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'pci_devices' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:30:08 user nova-compute[72818]:   <uuid>e15761ac-028d-40a9-931d-51ef8b77c1cf</uuid>
Aug 17 21:30:08 user nova-compute[72818]:   <name>instance-0000001c</name>
Aug 17 21:30:08 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:30:08 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:30:08 user nova-compute[72818]:   <metadata>
Aug 17 21:30:08 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:30:08 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:30:08 user nova-compute[72818]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2146804663</nova:name>
Aug 17 21:30:08 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:30:08</nova:creationTime>
Aug 17 21:30:08 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:30:08 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:30:08 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:30:08 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:30:08 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:30:08 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:30:08 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:30:08 user nova-compute[72818]:       <nova:owner>
Aug 17 21:30:08 user nova-compute[72818]:         <nova:user uuid="8ffa40080d9842b1a4f6a3e041b5d123">tempest-ServerRescueNegativeTestJSON-713886303-project-member</nova:user>
Aug 17 21:30:08 user nova-compute[72818]:         <nova:project uuid="7f6bdddb43364e86b302c9c2e273fd44">tempest-ServerRescueNegativeTestJSON-713886303</nova:project>
Aug 17 21:30:08 user nova-compute[72818]:       </nova:owner>
Aug 17 21:30:08 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:30:08 user nova-compute[72818]:       <nova:ports>
Aug 17 21:30:08 user nova-compute[72818]:         <nova:port uuid="ff979858-3d61-4234-b7fc-f3f738f6e640">
Aug 17 21:30:08 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 21:30:08 user nova-compute[72818]:         </nova:port>
Aug 17 21:30:08 user nova-compute[72818]:       </nova:ports>
Aug 17 21:30:08 user nova-compute[72818]:     </nova:instance>
Aug 17 21:30:08 user nova-compute[72818]:   </metadata>
Aug 17 21:30:08 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:30:08 user nova-compute[72818]:     <system>
Aug 17 21:30:08 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:30:08 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:30:08 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:30:08 user nova-compute[72818]:       <entry name="serial">e15761ac-028d-40a9-931d-51ef8b77c1cf</entry>
Aug 17 21:30:08 user nova-compute[72818]:       <entry name="uuid">e15761ac-028d-40a9-931d-51ef8b77c1cf</entry>
Aug 17 21:30:08 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:30:08 user nova-compute[72818]:     </system>
Aug 17 21:30:08 user nova-compute[72818]:   </sysinfo>
Aug 17 21:30:08 user nova-compute[72818]:   <os>
Aug 17 21:30:08 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:30:08 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:30:08 user nova-compute[72818]:   </os>
Aug 17 21:30:08 user nova-compute[72818]:   <features>
Aug 17 21:30:08 user nova-compute[72818]:     <acpi/>
Aug 17 21:30:08 user nova-compute[72818]:     <apic/>
Aug 17 21:30:08 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:30:08 user nova-compute[72818]:   </features>
Aug 17 21:30:08 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:30:08 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:30:08 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:30:08 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:30:08 user nova-compute[72818]:   </clock>
Aug 17 21:30:08 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:30:08 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:30:08 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:30:08 user nova-compute[72818]:   </cpu>
Aug 17 21:30:08 user nova-compute[72818]:   <devices>
Aug 17 21:30:08 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:30:08 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:30:08 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.rescue"/>
Aug 17 21:30:08 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:30:08 user nova-compute[72818]:     </disk>
Aug 17 21:30:08 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:30:08 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:30:08 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk"/>
Aug 17 21:30:08 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:30:08 user nova-compute[72818]:     </disk>
Aug 17 21:30:08 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:30:08 user nova-compute[72818]:       <mac address="fa:16:3e:c4:d9:ba"/>
Aug 17 21:30:08 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:30:08 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:30:08 user nova-compute[72818]:       <target dev="tapff979858-3d"/>
Aug 17 21:30:08 user nova-compute[72818]:     </interface>
Aug 17 21:30:08 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:30:08 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/console.log" append="off"/>
Aug 17 21:30:08 user nova-compute[72818]:     </serial>
Aug 17 21:30:08 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:30:08 user nova-compute[72818]:     <video>
Aug 17 21:30:08 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:30:08 user nova-compute[72818]:     </video>
Aug 17 21:30:08 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:30:08 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:30:08 user nova-compute[72818]:     </rng>
Aug 17 21:30:08 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:30:08 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:30:08 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:30:08 user nova-compute[72818]:     </memballoon>
Aug 17 21:30:08 user nova-compute[72818]:   </devices>
Aug 17 21:30:08 user nova-compute[72818]: </domain>
Aug 17 21:30:08 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:30:08 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Instance destroyed successfully.
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] No VIF found with MAC fa:16:3e:c4:d9:ba, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-unplugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] No waiting events found dispatching network-vif-unplugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:08 user nova-compute[72818]: WARNING nova.compute.manager [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received unexpected event network-vif-unplugged-ff979858-3d61-4234-b7fc-f3f738f6e640 for instance with vm_state active and task_state rescuing.
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] No waiting events found dispatching network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:08 user nova-compute[72818]: WARNING nova.compute.manager [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received unexpected event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 for instance with vm_state active and task_state rescuing.
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] No waiting events found dispatching network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:08 user nova-compute[72818]: WARNING nova.compute.manager [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received unexpected event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] No waiting events found dispatching network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:08 user nova-compute[72818]: WARNING nova.compute.manager [req-ff494d57-af99-4c51-9bef-6927f8f4d5a7 req-5c71bc22-1ad3-490a-a430-764bc079fdb7 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received unexpected event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:30:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:08 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307793.939747, 8ab794f2-ef30-4524-8eea-224873d6f0b5 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:30:08 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] VM Stopped (Lifecycle Event)
Aug 17 21:30:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-30e47387-d233-4e9e-ba1a-98523dac3482 None None] [instance: 8ab794f2-ef30-4524-8eea-224873d6f0b5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for d54920e2-56cf-4c58-b66a-a454470c57d6 due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307809.6869638, d54920e2-56cf-4c58-b66a-a454470c57d6 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:30:09 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] VM Resumed (Lifecycle Event)
Aug 17 21:30:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-64f11f2d-f169-438c-9599-89bc8e6cac78 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307809.7005208, d54920e2-56cf-4c58-b66a-a454470c57d6 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:30:09 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] VM Started (Lifecycle Event)
Aug 17 21:30:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-197982c3-9203-43be-b239-439462807a06 req-8b84733b-127c-4b15-ba90-66df57750add service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-197982c3-9203-43be-b239-439462807a06 req-8b84733b-127c-4b15-ba90-66df57750add service nova] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-197982c3-9203-43be-b239-439462807a06 req-8b84733b-127c-4b15-ba90-66df57750add service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-197982c3-9203-43be-b239-439462807a06 req-8b84733b-127c-4b15-ba90-66df57750add service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-197982c3-9203-43be-b239-439462807a06 req-8b84733b-127c-4b15-ba90-66df57750add service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] No waiting events found dispatching network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:10 user nova-compute[72818]: WARNING nova.compute.manager [req-197982c3-9203-43be-b239-439462807a06 req-8b84733b-127c-4b15-ba90-66df57750add service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received unexpected event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 for instance with vm_state active and task_state rescuing.
Aug 17 21:30:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-197982c3-9203-43be-b239-439462807a06 req-8b84733b-127c-4b15-ba90-66df57750add service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-197982c3-9203-43be-b239-439462807a06 req-8b84733b-127c-4b15-ba90-66df57750add service nova] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-197982c3-9203-43be-b239-439462807a06 req-8b84733b-127c-4b15-ba90-66df57750add service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-197982c3-9203-43be-b239-439462807a06 req-8b84733b-127c-4b15-ba90-66df57750add service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-197982c3-9203-43be-b239-439462807a06 req-8b84733b-127c-4b15-ba90-66df57750add service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] No waiting events found dispatching network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:10 user nova-compute[72818]: WARNING nova.compute.manager [req-197982c3-9203-43be-b239-439462807a06 req-8b84733b-127c-4b15-ba90-66df57750add service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received unexpected event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 for instance with vm_state active and task_state rescuing.
Aug 17 21:30:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:30:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:30:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d43397a4-bf8f-4f77-85cf-b074b7930bd0 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for e15761ac-028d-40a9-931d-51ef8b77c1cf due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 21:30:12 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307812.3764765, e15761ac-028d-40a9-931d-51ef8b77c1cf => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:30:12 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] VM Resumed (Lifecycle Event)
Aug 17 21:30:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:30:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:30:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7736MB free_disk=25.197689056396484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:30:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:30:12 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 21:30:12 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307812.3783534, e15761ac-028d-40a9-931d-51ef8b77c1cf => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:30:12 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] VM Started (Lifecycle Event)
Aug 17 21:30:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 6c46354a-2316-4703-b7fb-431fa37df1ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance d54920e2-56cf-4c58-b66a-a454470c57d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e15761ac-028d-40a9-931d-51ef8b77c1cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUwgBsdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:30:13 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:30:13 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:30:13 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[68736133-735f-4998-bad0-cc2a172567da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:30:13 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c051529-499a-4bd4-b6d0-865962810ec5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a] added
Aug 17 21:30:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b27e12a-9aa9-4dd6-8e10-a3992458c646]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b5265e-29ef-4432-95b8-3e6bbbfdcef0]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUwgBsdR {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUwgBsdR" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b730fc-a71c-4270-af4e-928a390d828b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mUwgBsdR'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d8a15e-c98a-40b5-8d84-fa5d3c93f77a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2453961b-afea-4e9e-82df-3114fc438833]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:30:13 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:30:13 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:30:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:30:13 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:30:13 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:30:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3936af-bce3-43f0-9aa3-86a3f9cdb041]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260]
Aug 17 21:30:13 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260] successful.
Aug 17 21:30:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f201e5b4-07bb-4b34-837b-65cafbeaba4a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6475f6-74a6-4a0a-b890-450265fc8827]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:30:13 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:30:13 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:30:13 user nova-compute[72818]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:30:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:30:13 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:30:13 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:30:13 user nova-compute[72818]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:30:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17e5465-b22f-4bd3-bcc2-541807b1e29b]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:30:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:30:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUwgBsdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:30:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:30:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23638393937663734', 'path': '/dev/sdd'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:30:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638393937663734', 'path': '/dev/sdd'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:30:14 user nova-compute[72818]: DEBUG nova.objects.instance [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:30:14 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:30:14 user nova-compute[72818]:   <source dev="/dev/sdd"/>
Aug 17 21:30:14 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:30:14 user nova-compute[72818]:   <serial>28aedce7-4232-412f-ba04-bd66b329c60a</serial>
Aug 17 21:30:14 user nova-compute[72818]: </disk>
Aug 17 21:30:14 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:30:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:30:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:30:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No VIF found with MAC fa:16:3e:dc:c2:13, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:30:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-3db8af74-5b6b-4f23-a718-3cbe2af3d305 req-c072b8ab-2983-411e-b57c-794d6e2a5a7b service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-changed-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-3db8af74-5b6b-4f23-a718-3cbe2af3d305 req-c072b8ab-2983-411e-b57c-794d6e2a5a7b service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Refreshing instance network info cache due to event network-changed-758c519d-4502-4a83-9900-5cdfbc22c4f3. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:30:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3db8af74-5b6b-4f23-a718-3cbe2af3d305 req-c072b8ab-2983-411e-b57c-794d6e2a5a7b service nova] Acquiring lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:30:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3db8af74-5b6b-4f23-a718-3cbe2af3d305 req-c072b8ab-2983-411e-b57c-794d6e2a5a7b service nova] Acquired lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:30:15 user nova-compute[72818]: DEBUG nova.network.neutron [req-3db8af74-5b6b-4f23-a718-3cbe2af3d305 req-c072b8ab-2983-411e-b57c-794d6e2a5a7b service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Refreshing network info cache for port 758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:30:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-032b0d9a-d581-449c-922b-607287b3b9f8 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.469s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG nova.network.neutron [req-3db8af74-5b6b-4f23-a718-3cbe2af3d305 req-c072b8ab-2983-411e-b57c-794d6e2a5a7b service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updated VIF entry in instance network info cache for port 758c519d-4502-4a83-9900-5cdfbc22c4f3. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG nova.network.neutron [req-3db8af74-5b6b-4f23-a718-3cbe2af3d305 req-c072b8ab-2983-411e-b57c-794d6e2a5a7b service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updating instance_info_cache with network_info: [{"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3db8af74-5b6b-4f23-a718-3cbe2af3d305 req-c072b8ab-2983-411e-b57c-794d6e2a5a7b service nova] Releasing lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0f20b24-ce6a-43d3-b61f-5b5ba68bf374 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0f20b24-ce6a-43d3-b61f-5b5ba68bf374 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b0f20b24-ce6a-43d3-b61f-5b5ba68bf374 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "61d219ec-0254-41a1-8b53-9177cfe9b585" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b0f20b24-ce6a-43d3-b61f-5b5ba68bf374 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72818) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b0f20b24-ce6a-43d3-b61f-5b5ba68bf374 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:30:16 user nova-compute[72818]: INFO nova.compute.claims [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Claim successful on node user
Aug 17 21:30:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:16 user nova-compute[72818]: INFO nova.compute.manager [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] instance snapshotting
Aug 17 21:30:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-fc3b9ab6-2fe8-47a9-b91e-66204b984004 req-b9fc246a-fbbc-473a-b556-6e2fa679537e service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-unplugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc3b9ab6-2fe8-47a9-b91e-66204b984004 req-b9fc246a-fbbc-473a-b556-6e2fa679537e service nova] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc3b9ab6-2fe8-47a9-b91e-66204b984004 req-b9fc246a-fbbc-473a-b556-6e2fa679537e service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc3b9ab6-2fe8-47a9-b91e-66204b984004 req-b9fc246a-fbbc-473a-b556-6e2fa679537e service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-fc3b9ab6-2fe8-47a9-b91e-66204b984004 req-b9fc246a-fbbc-473a-b556-6e2fa679537e service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] No waiting events found dispatching network-vif-unplugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:17 user nova-compute[72818]: WARNING nova.compute.manager [req-fc3b9ab6-2fe8-47a9-b91e-66204b984004 req-b9fc246a-fbbc-473a-b556-6e2fa679537e service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received unexpected event network-vif-unplugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d for instance with vm_state active and task_state powering-off.
Aug 17 21:30:17 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Beginning live snapshot process
Aug 17 21:30:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json -f qcow2 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json -f qcow2" returned: 0 in 0.237s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json -f qcow2 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.788s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:30:17 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance destroyed successfully.
Aug 17 21:30:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b0f20b24-ce6a-43d3-b61f-5b5ba68bf374 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b0f20b24-ce6a-43d3-b61f-5b5ba68bf374 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.029s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:30:17 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:30:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json -f qcow2" returned: 0 in 0.222s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG nova.policy [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de902559a8794d1a8af9c0efbed4e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92abc22a192a44398dffe75ffae6d270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:30:17 user nova-compute[72818]: INFO nova.virt.block_device [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Booting with volume 91f23a3f-f895-48f1-8e1a-a894d968dd42 at /dev/vda
Aug 17 21:30:17 user nova-compute[72818]: DEBUG os_brick.utils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.269s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphtzddcr4/001accadd411436bb651f4868863b6be.delta 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5250c2a-adbc-492a-b700-6d3e05e95851]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphtzddcr4/001accadd411436bb651f4868863b6be.delta 1073741824" returned: 0 in 0.057s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:18 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f52868-a24d-4ab2-9109-89b5da10bfdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5c42f9-ae7c-4355-b0fb-e31a8512a7ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb271e4e-7dc6-4b98-a551-aab268e0b3a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:30:18 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:30:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce66016-bfbd-4a12-8abd-92ac5f4e1ef7]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG os_brick.utils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Updating existing volume attachment record: cbe5079c-6661-427d-80e6-7791873e290c {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Successfully created port: 24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307803.8447716, 774642dc-1888-4f4e-9485-b6dfe7ad6a7f => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:30:18 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] VM Stopped (Lifecycle Event)
Aug 17 21:30:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-59c58a75-132b-4790-8ba9-01a2460fcf55 None None] [instance: 774642dc-1888-4f4e-9485-b6dfe7ad6a7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72818) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 21:30:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-b0113c38-65eb-4ce7-8a6a-d7d085d60420 req-f5730dda-e99d-4955-ac39-f04ab63cb77c service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b0113c38-65eb-4ce7-8a6a-d7d085d60420 req-f5730dda-e99d-4955-ac39-f04ab63cb77c service nova] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b0113c38-65eb-4ce7-8a6a-d7d085d60420 req-f5730dda-e99d-4955-ac39-f04ab63cb77c service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b0113c38-65eb-4ce7-8a6a-d7d085d60420 req-f5730dda-e99d-4955-ac39-f04ab63cb77c service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-b0113c38-65eb-4ce7-8a6a-d7d085d60420 req-f5730dda-e99d-4955-ac39-f04ab63cb77c service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] No waiting events found dispatching network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:19 user nova-compute[72818]: WARNING nova.compute.manager [req-b0113c38-65eb-4ce7-8a6a-d7d085d60420 req-f5730dda-e99d-4955-ac39-f04ab63cb77c service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received unexpected event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d for instance with vm_state stopped and task_state None.
Aug 17 21:30:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72818) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 21:30:19 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 21:30:19 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphtzddcr4/001accadd411436bb651f4868863b6be.delta /opt/stack/data/nova/instances/snapshots/tmphtzddcr4/001accadd411436bb651f4868863b6be {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Successfully updated port: 24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-fc0101f9-8fd3-4bf0-819f-acde2d2789c7 req-f00bd002-8f3b-4049-b256-c0cdc0b86e20 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Received event network-changed-24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-fc0101f9-8fd3-4bf0-819f-acde2d2789c7 req-f00bd002-8f3b-4049-b256-c0cdc0b86e20 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Refreshing instance network info cache due to event network-changed-24416426-2fb4-4a5c-bd06-d2e3aee656e7. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc0101f9-8fd3-4bf0-819f-acde2d2789c7 req-f00bd002-8f3b-4049-b256-c0cdc0b86e20 service nova] Acquiring lock "refresh_cache-61d219ec-0254-41a1-8b53-9177cfe9b585" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc0101f9-8fd3-4bf0-819f-acde2d2789c7 req-f00bd002-8f3b-4049-b256-c0cdc0b86e20 service nova] Acquired lock "refresh_cache-61d219ec-0254-41a1-8b53-9177cfe9b585" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG nova.network.neutron [req-fc0101f9-8fd3-4bf0-819f-acde2d2789c7 req-f00bd002-8f3b-4049-b256-c0cdc0b86e20 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Refreshing network info cache for port 24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "refresh_cache-61d219ec-0254-41a1-8b53-9177cfe9b585" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG nova.network.neutron [req-fc0101f9-8fd3-4bf0-819f-acde2d2789c7 req-f00bd002-8f3b-4049-b256-c0cdc0b86e20 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:30:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphtzddcr4/001accadd411436bb651f4868863b6be.delta /opt/stack/data/nova/instances/snapshots/tmphtzddcr4/001accadd411436bb651f4868863b6be" returned: 0 in 0.457s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:19 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Snapshot extracted, beginning image upload
Aug 17 21:30:20 user nova-compute[72818]: DEBUG nova.network.neutron [req-fc0101f9-8fd3-4bf0-819f-acde2d2789c7 req-f00bd002-8f3b-4049-b256-c0cdc0b86e20 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:30:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc0101f9-8fd3-4bf0-819f-acde2d2789c7 req-f00bd002-8f3b-4049-b256-c0cdc0b86e20 service nova] Releasing lock "refresh_cache-61d219ec-0254-41a1-8b53-9177cfe9b585" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:30:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquired lock "refresh_cache-61d219ec-0254-41a1-8b53-9177cfe9b585" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:30:20 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:30:20 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:30:20 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Updating instance_info_cache with network_info: [{"id": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "address": "fa:16:3e:e7:5c:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24416426-2f", "ovs_interfaceid": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:30:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Releasing lock "refresh_cache-61d219ec-0254-41a1-8b53-9177cfe9b585" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:30:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Instance network_info: |[{"id": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "address": "fa:16:3e:e7:5c:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24416426-2f", "ovs_interfaceid": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:30:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:23 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Snapshot image upload complete
Aug 17 21:30:23 user nova-compute[72818]: INFO nova.compute.manager [None req-47110b5f-b1e3-42b7-895c-a9dfaef132c9 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Took 6.55 seconds to snapshot the instance on the hypervisor.
Aug 17 21:30:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:32 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307817.507239, e322a0ce-e887-4e29-a5c4-a0da74db3c7f => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:30:32 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] VM Stopped (Lifecycle Event)
Aug 17 21:30:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-94cc1bff-ff04-4a1f-ae23-65ffc8b51d71 None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-94cc1bff-ff04-4a1f-ae23-65ffc8b51d71 None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:30:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:30:37 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Creating image(s)
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Ensure instance console log exists: /opt/stack/data/nova/instances/61d219ec-0254-41a1-8b53-9177cfe9b585/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Start _get_guest_xml network_info=[{"id": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "address": "fa:16:3e:e7:5c:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24416426-2f", "ovs_interfaceid": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'cbe5079c-6661-427d-80e6-7791873e290c', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZkbdeJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '61d219ec-0254-41a1-8b53-9177cfe9b585', 'attached_at': '', 'detached_at': '', 'volume_id': '91f23a3f-f895-48f1-8e1a-a894d968dd42', 'serial': '91f23a3f-f895-48f1-8e1a-a894d968dd42'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:30:37 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:30:37 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZkbdeJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:30:37 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:30:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:30:37 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:30:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:30:37 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:30:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[396c81e2-c74b-43bb-be67-fe9c402cef52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:30:37 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[28969088-0a2e-4695-ab5c-90eb2851055a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42] added
Aug 17 21:30:37 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2aa122-dba2-4bee-830d-dc69d48695b2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffb6241-ac0d-4981-98fb-ef470072a997]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZkbdeJr {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZkbdeJr" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2608a2-d47e-4b20-aff3-1c746937861c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tZkbdeJr'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94c04f7-0c06-4d6a-b6e5-46782fbe9157]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[79955c61-9967-4688-9905-f97dcab56d69]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:30:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:30:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0db096f-8137-4edc-86f3-0bd91f99c259]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42, portal: 172.16.0.220,3260]
Aug 17 21:30:38 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42, portal: 172.16.0.220,3260] successful.
Aug 17 21:30:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b57e390-a518-485a-b977-826207d08aa1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9900a1-d0cd-4b21-a216-0f4b28976913]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:30:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:30:38 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:30:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[339e6e71-5adc-401e-b90a-aaaa9da5d5a4]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZkbdeJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:30:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26133346532623732', 'path': '/dev/sde'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133346532623732', 'path': '/dev/sde'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:30:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1927687644',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1927687644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1927687644',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0izqoaOqMe8RGDfeTA4LTdOg2Nkd8TEzLVLsIK7suEm2g3Ne3+GTe9cQuNzjREiuxRh12ZIBNlfCZcPoAgZ5Kavp6Rf96BpOz+py+cmRJsJjylJ5tHvRSbiaEPqdMRiA==',key_name='tempest-keypair-1634734999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-ei1bghkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=61d219ec-0254-41a1-8b53-9177cfe9b585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "address": "fa:16:3e:e7:5c:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24416426-2f", "ovs_interfaceid": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "address": "fa:16:3e:e7:5c:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24416426-2f", "ovs_interfaceid": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=24416426-2fb4-4a5c-bd06-d2e3aee656e7,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24416426-2f') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lazy-loading 'pci_devices' on Instance uuid 61d219ec-0254-41a1-8b53-9177cfe9b585 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:30:39 user nova-compute[72818]:   <uuid>61d219ec-0254-41a1-8b53-9177cfe9b585</uuid>
Aug 17 21:30:39 user nova-compute[72818]:   <name>instance-0000001f</name>
Aug 17 21:30:39 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:30:39 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:30:39 user nova-compute[72818]:   <metadata>
Aug 17 21:30:39 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:30:39 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:30:39 user nova-compute[72818]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1927687644</nova:name>
Aug 17 21:30:39 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:30:37</nova:creationTime>
Aug 17 21:30:39 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:30:39 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:30:39 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:30:39 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:30:39 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:30:39 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:30:39 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:30:39 user nova-compute[72818]:       <nova:owner>
Aug 17 21:30:39 user nova-compute[72818]:         <nova:user uuid="de902559a8794d1a8af9c0efbed4e38a">tempest-TestVolumeBootPattern-973058317-project-member</nova:user>
Aug 17 21:30:39 user nova-compute[72818]:         <nova:project uuid="92abc22a192a44398dffe75ffae6d270">tempest-TestVolumeBootPattern-973058317</nova:project>
Aug 17 21:30:39 user nova-compute[72818]:       </nova:owner>
Aug 17 21:30:39 user nova-compute[72818]:       <nova:ports>
Aug 17 21:30:39 user nova-compute[72818]:         <nova:port uuid="24416426-2fb4-4a5c-bd06-d2e3aee656e7">
Aug 17 21:30:39 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 21:30:39 user nova-compute[72818]:         </nova:port>
Aug 17 21:30:39 user nova-compute[72818]:       </nova:ports>
Aug 17 21:30:39 user nova-compute[72818]:     </nova:instance>
Aug 17 21:30:39 user nova-compute[72818]:   </metadata>
Aug 17 21:30:39 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:30:39 user nova-compute[72818]:     <system>
Aug 17 21:30:39 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:30:39 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:30:39 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:30:39 user nova-compute[72818]:       <entry name="serial">61d219ec-0254-41a1-8b53-9177cfe9b585</entry>
Aug 17 21:30:39 user nova-compute[72818]:       <entry name="uuid">61d219ec-0254-41a1-8b53-9177cfe9b585</entry>
Aug 17 21:30:39 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:30:39 user nova-compute[72818]:     </system>
Aug 17 21:30:39 user nova-compute[72818]:   </sysinfo>
Aug 17 21:30:39 user nova-compute[72818]:   <os>
Aug 17 21:30:39 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:30:39 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:30:39 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:30:39 user nova-compute[72818]:   </os>
Aug 17 21:30:39 user nova-compute[72818]:   <features>
Aug 17 21:30:39 user nova-compute[72818]:     <acpi/>
Aug 17 21:30:39 user nova-compute[72818]:     <apic/>
Aug 17 21:30:39 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:30:39 user nova-compute[72818]:   </features>
Aug 17 21:30:39 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:30:39 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:30:39 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:30:39 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:30:39 user nova-compute[72818]:   </clock>
Aug 17 21:30:39 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:30:39 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:30:39 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:30:39 user nova-compute[72818]:   </cpu>
Aug 17 21:30:39 user nova-compute[72818]:   <devices>
Aug 17 21:30:39 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:30:39 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:30:39 user nova-compute[72818]:       <source dev="/dev/sde"/>
Aug 17 21:30:39 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:30:39 user nova-compute[72818]:       <serial>91f23a3f-f895-48f1-8e1a-a894d968dd42</serial>
Aug 17 21:30:39 user nova-compute[72818]:     </disk>
Aug 17 21:30:39 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:30:39 user nova-compute[72818]:       <mac address="fa:16:3e:e7:5c:da"/>
Aug 17 21:30:39 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:30:39 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:30:39 user nova-compute[72818]:       <target dev="tap24416426-2f"/>
Aug 17 21:30:39 user nova-compute[72818]:     </interface>
Aug 17 21:30:39 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:30:39 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/61d219ec-0254-41a1-8b53-9177cfe9b585/console.log" append="off"/>
Aug 17 21:30:39 user nova-compute[72818]:     </serial>
Aug 17 21:30:39 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:30:39 user nova-compute[72818]:     <video>
Aug 17 21:30:39 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:30:39 user nova-compute[72818]:     </video>
Aug 17 21:30:39 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:30:39 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:30:39 user nova-compute[72818]:     </rng>
Aug 17 21:30:39 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:30:39 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:30:39 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:30:39 user nova-compute[72818]:     </memballoon>
Aug 17 21:30:39 user nova-compute[72818]:   </devices>
Aug 17 21:30:39 user nova-compute[72818]: </domain>
Aug 17 21:30:39 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:30:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1927687644',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1927687644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1927687644',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0izqoaOqMe8RGDfeTA4LTdOg2Nkd8TEzLVLsIK7suEm2g3Ne3+GTe9cQuNzjREiuxRh12ZIBNlfCZcPoAgZ5Kavp6Rf96BpOz+py+cmRJsJjylJ5tHvRSbiaEPqdMRiA==',key_name='tempest-keypair-1634734999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-ei1bghkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=61d219ec-0254-41a1-8b53-9177cfe9b585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "address": "fa:16:3e:e7:5c:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24416426-2f", "ovs_interfaceid": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "address": "fa:16:3e:e7:5c:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24416426-2f", "ovs_interfaceid": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=24416426-2fb4-4a5c-bd06-d2e3aee656e7,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24416426-2f') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG os_vif [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=24416426-2fb4-4a5c-bd06-d2e3aee656e7,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24416426-2f') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24416426-2f, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24416426-2f, col_values=(('external_ids', {'iface-id': '24416426-2fb4-4a5c-bd06-d2e3aee656e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:5c:da', 'vm-uuid': '61d219ec-0254-41a1-8b53-9177cfe9b585'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:39 user nova-compute[72818]: INFO os_vif [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=24416426-2fb4-4a5c-bd06-d2e3aee656e7,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24416426-2f')
Aug 17 21:30:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:30:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] No VIF found with MAC fa:16:3e:e7:5c:da, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:30:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-a635787e-74e9-4e65-afc3-ed3267dd1f7e req-188d01cc-2d6f-4787-b04c-eb2fd5f399c1 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Received event network-vif-plugged-24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a635787e-74e9-4e65-afc3-ed3267dd1f7e req-188d01cc-2d6f-4787-b04c-eb2fd5f399c1 service nova] Acquiring lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a635787e-74e9-4e65-afc3-ed3267dd1f7e req-188d01cc-2d6f-4787-b04c-eb2fd5f399c1 service nova] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a635787e-74e9-4e65-afc3-ed3267dd1f7e req-188d01cc-2d6f-4787-b04c-eb2fd5f399c1 service nova] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-a635787e-74e9-4e65-afc3-ed3267dd1f7e req-188d01cc-2d6f-4787-b04c-eb2fd5f399c1 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] No waiting events found dispatching network-vif-plugged-24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:41 user nova-compute[72818]: WARNING nova.compute.manager [req-a635787e-74e9-4e65-afc3-ed3267dd1f7e req-188d01cc-2d6f-4787-b04c-eb2fd5f399c1 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Received unexpected event network-vif-plugged-24416426-2fb4-4a5c-bd06-d2e3aee656e7 for instance with vm_state building and task_state spawning.
Aug 17 21:30:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307842.7439568, 61d219ec-0254-41a1-8b53-9177cfe9b585 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:30:42 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] VM Resumed (Lifecycle Event)
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:30:42 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Instance spawned successfully.
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:30:42 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307842.7457187, 61d219ec-0254-41a1-8b53-9177cfe9b585 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:30:42 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] VM Started (Lifecycle Event)
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:30:42 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:30:42 user nova-compute[72818]: INFO nova.compute.manager [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 17 21:30:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:30:42 user nova-compute[72818]: INFO nova.compute.manager [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Took 26.21 seconds to build instance.
Aug 17 21:30:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b6e50f02-011f-4e8b-84e8-2e5454fc4c70 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.332s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-eb6f8c91-9353-441e-aa30-5f1ad5f1ea42 req-1458c638-1667-4a7c-ac9a-1325146456f3 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Received event network-vif-plugged-24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:30:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-eb6f8c91-9353-441e-aa30-5f1ad5f1ea42 req-1458c638-1667-4a7c-ac9a-1325146456f3 service nova] Acquiring lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:30:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-eb6f8c91-9353-441e-aa30-5f1ad5f1ea42 req-1458c638-1667-4a7c-ac9a-1325146456f3 service nova] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:30:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-eb6f8c91-9353-441e-aa30-5f1ad5f1ea42 req-1458c638-1667-4a7c-ac9a-1325146456f3 service nova] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:30:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-eb6f8c91-9353-441e-aa30-5f1ad5f1ea42 req-1458c638-1667-4a7c-ac9a-1325146456f3 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] No waiting events found dispatching network-vif-plugged-24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:30:43 user nova-compute[72818]: WARNING nova.compute.manager [req-eb6f8c91-9353-441e-aa30-5f1ad5f1ea42 req-1458c638-1667-4a7c-ac9a-1325146456f3 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Received unexpected event network-vif-plugged-24416426-2fb4-4a5c-bd06-d2e3aee656e7 for instance with vm_state active and task_state None.
Aug 17 21:30:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:30:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:30:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:03 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:03 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:31:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:31:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:31:03 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:31:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:04 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Updating instance_info_cache with network_info: [{"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:31:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-827d6c12-deb5-4c05-ad6b-efba319783e9" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:31:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:31:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:31:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:05 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:05 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:31:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:31:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:31:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:31:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:31:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:31:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:31:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:31:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7505MB free_disk=25.145065307617188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:31:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 6c46354a-2316-4703-b7fb-431fa37df1ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance d54920e2-56cf-4c58-b66a-a454470c57d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e15761ac-028d-40a9-931d-51ef8b77c1cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 61d219ec-0254-41a1-8b53-9177cfe9b585 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing inventories for resource provider d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating ProviderTree inventory for provider d156e3af-684d-47e1-a951-585f9c95fa46 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing aggregate associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, aggregates: None {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing trait associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.827s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] There are 0 instances to clean {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72818) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 21:31:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:31:16 user nova-compute[72818]: INFO nova.compute.claims [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Claim successful on node user
Aug 17 21:31:16 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG nova.network.neutron [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:16 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:31:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:31:16 user nova-compute[72818]: DEBUG nova.policy [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3f15f3e00b74f6daf091110f53fa137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4157791638140e8b3d82e46a4e86d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:31:17 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Creating image(s)
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "/opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "/opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "/opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk 1073741824" returned: 0 in 0.049s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Successfully created port: ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.187s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Cannot resize image /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG nova.objects.instance [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lazy-loading 'migration_context' on Instance uuid 56115fdf-0fdd-4cce-9ae0-6046422f0a56 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Ensure instance console log exists: /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.network.neutron [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Successfully updated port: ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "refresh_cache-56115fdf-0fdd-4cce-9ae0-6046422f0a56" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquired lock "refresh_cache-56115fdf-0fdd-4cce-9ae0-6046422f0a56" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.network.neutron [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.compute.manager [req-974b074e-2536-4c11-bbeb-3ba3e5b2176c req-e0bfa54f-2df6-438c-99ff-169c47ee9503 service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Received event network-changed-ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.compute.manager [req-974b074e-2536-4c11-bbeb-3ba3e5b2176c req-e0bfa54f-2df6-438c-99ff-169c47ee9503 service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Refreshing instance network info cache due to event network-changed-ff5905b9-ac5a-454f-9259-5a2a368e56e1. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-974b074e-2536-4c11-bbeb-3ba3e5b2176c req-e0bfa54f-2df6-438c-99ff-169c47ee9503 service nova] Acquiring lock "refresh_cache-56115fdf-0fdd-4cce-9ae0-6046422f0a56" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.network.neutron [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.network.neutron [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Updating instance_info_cache with network_info: [{"id": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "address": "fa:16:3e:82:e1:d4", "network": {"id": "d2c00f25-1657-4d58-afd2-bf48698d2457", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109276971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4157791638140e8b3d82e46a4e86d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5905b9-ac", "ovs_interfaceid": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Releasing lock "refresh_cache-56115fdf-0fdd-4cce-9ae0-6046422f0a56" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Instance network_info: |[{"id": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "address": "fa:16:3e:82:e1:d4", "network": {"id": "d2c00f25-1657-4d58-afd2-bf48698d2457", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109276971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4157791638140e8b3d82e46a4e86d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5905b9-ac", "ovs_interfaceid": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-974b074e-2536-4c11-bbeb-3ba3e5b2176c req-e0bfa54f-2df6-438c-99ff-169c47ee9503 service nova] Acquired lock "refresh_cache-56115fdf-0fdd-4cce-9ae0-6046422f0a56" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.network.neutron [req-974b074e-2536-4c11-bbeb-3ba3e5b2176c req-e0bfa54f-2df6-438c-99ff-169c47ee9503 service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Refreshing network info cache for port ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Start _get_guest_xml network_info=[{"id": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "address": "fa:16:3e:82:e1:d4", "network": {"id": "d2c00f25-1657-4d58-afd2-bf48698d2457", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109276971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4157791638140e8b3d82e46a4e86d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5905b9-ac", "ovs_interfaceid": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:31:18 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:31:18 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-464628563',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-464628563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4646285',id=32,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzQ+LlCVfXbGq9vgal2PjXmP9MW9II1D8FHFfgZSQldnhfOaEVBVTS/ITiEba2ePvxBg6/eKGe80Rz0nTucF624iPRxkL0rZqbXWc8C7AaH3uHDXEiNMn2DBtp2Wwj3BQ==',key_name='tempest-keypair-1742254251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4157791638140e8b3d82e46a4e86d46',ramdisk_id='',reservation_id='r-dcnpigfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2016053776',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:31:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3f15f3e00b74f6daf091110f53fa137',uuid=56115fdf-0fdd-4cce-9ae0-6046422f0a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "address": "fa:16:3e:82:e1:d4", "network": {"id": "d2c00f25-1657-4d58-afd2-bf48698d2457", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109276971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4157791638140e8b3d82e46a4e86d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5905b9-ac", "ovs_interfaceid": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Converting VIF {"id": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "address": "fa:16:3e:82:e1:d4", "network": {"id": "d2c00f25-1657-4d58-afd2-bf48698d2457", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109276971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4157791638140e8b3d82e46a4e86d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5905b9-ac", "ovs_interfaceid": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:e1:d4,bridge_name='br-int',has_traffic_filtering=True,id=ff5905b9-ac5a-454f-9259-5a2a368e56e1,network=Network(d2c00f25-1657-4d58-afd2-bf48698d2457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5905b9-ac') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.objects.instance [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lazy-loading 'pci_devices' on Instance uuid 56115fdf-0fdd-4cce-9ae0-6046422f0a56 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:31:18 user nova-compute[72818]:   <uuid>56115fdf-0fdd-4cce-9ae0-6046422f0a56</uuid>
Aug 17 21:31:18 user nova-compute[72818]:   <name>instance-00000020</name>
Aug 17 21:31:18 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:31:18 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:31:18 user nova-compute[72818]:   <metadata>
Aug 17 21:31:18 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:31:18 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:31:18 user nova-compute[72818]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-464628563</nova:name>
Aug 17 21:31:18 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:31:18</nova:creationTime>
Aug 17 21:31:18 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:31:18 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:31:18 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:31:18 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:31:18 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:31:18 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:31:18 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:31:18 user nova-compute[72818]:       <nova:owner>
Aug 17 21:31:18 user nova-compute[72818]:         <nova:user uuid="a3f15f3e00b74f6daf091110f53fa137">tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member</nova:user>
Aug 17 21:31:18 user nova-compute[72818]:         <nova:project uuid="f4157791638140e8b3d82e46a4e86d46">tempest-TestServerVolumeAttachScenarioOldVersion-2016053776</nova:project>
Aug 17 21:31:18 user nova-compute[72818]:       </nova:owner>
Aug 17 21:31:18 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:31:18 user nova-compute[72818]:       <nova:ports>
Aug 17 21:31:18 user nova-compute[72818]:         <nova:port uuid="ff5905b9-ac5a-454f-9259-5a2a368e56e1">
Aug 17 21:31:18 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 21:31:18 user nova-compute[72818]:         </nova:port>
Aug 17 21:31:18 user nova-compute[72818]:       </nova:ports>
Aug 17 21:31:18 user nova-compute[72818]:     </nova:instance>
Aug 17 21:31:18 user nova-compute[72818]:   </metadata>
Aug 17 21:31:18 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:31:18 user nova-compute[72818]:     <system>
Aug 17 21:31:18 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:31:18 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:31:18 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:31:18 user nova-compute[72818]:       <entry name="serial">56115fdf-0fdd-4cce-9ae0-6046422f0a56</entry>
Aug 17 21:31:18 user nova-compute[72818]:       <entry name="uuid">56115fdf-0fdd-4cce-9ae0-6046422f0a56</entry>
Aug 17 21:31:18 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:31:18 user nova-compute[72818]:     </system>
Aug 17 21:31:18 user nova-compute[72818]:   </sysinfo>
Aug 17 21:31:18 user nova-compute[72818]:   <os>
Aug 17 21:31:18 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:31:18 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:31:18 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:31:18 user nova-compute[72818]:   </os>
Aug 17 21:31:18 user nova-compute[72818]:   <features>
Aug 17 21:31:18 user nova-compute[72818]:     <acpi/>
Aug 17 21:31:18 user nova-compute[72818]:     <apic/>
Aug 17 21:31:18 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:31:18 user nova-compute[72818]:   </features>
Aug 17 21:31:18 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:31:18 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:31:18 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:31:18 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:31:18 user nova-compute[72818]:   </clock>
Aug 17 21:31:18 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:31:18 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:31:18 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:31:18 user nova-compute[72818]:   </cpu>
Aug 17 21:31:18 user nova-compute[72818]:   <devices>
Aug 17 21:31:18 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:31:18 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:31:18 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk"/>
Aug 17 21:31:18 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:31:18 user nova-compute[72818]:     </disk>
Aug 17 21:31:18 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:31:18 user nova-compute[72818]:       <mac address="fa:16:3e:82:e1:d4"/>
Aug 17 21:31:18 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:31:18 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:31:18 user nova-compute[72818]:       <target dev="tapff5905b9-ac"/>
Aug 17 21:31:18 user nova-compute[72818]:     </interface>
Aug 17 21:31:18 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:31:18 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/console.log" append="off"/>
Aug 17 21:31:18 user nova-compute[72818]:     </serial>
Aug 17 21:31:18 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:31:18 user nova-compute[72818]:     <video>
Aug 17 21:31:18 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:31:18 user nova-compute[72818]:     </video>
Aug 17 21:31:18 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:31:18 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:31:18 user nova-compute[72818]:     </rng>
Aug 17 21:31:18 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:31:18 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:31:18 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:31:18 user nova-compute[72818]:     </memballoon>
Aug 17 21:31:18 user nova-compute[72818]:   </devices>
Aug 17 21:31:18 user nova-compute[72818]: </domain>
Aug 17 21:31:18 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-464628563',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-464628563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4646285',id=32,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzQ+LlCVfXbGq9vgal2PjXmP9MW9II1D8FHFfgZSQldnhfOaEVBVTS/ITiEba2ePvxBg6/eKGe80Rz0nTucF624iPRxkL0rZqbXWc8C7AaH3uHDXEiNMn2DBtp2Wwj3BQ==',key_name='tempest-keypair-1742254251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4157791638140e8b3d82e46a4e86d46',ramdisk_id='',reservation_id='r-dcnpigfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2016053776',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:31:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3f15f3e00b74f6daf091110f53fa137',uuid=56115fdf-0fdd-4cce-9ae0-6046422f0a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "address": "fa:16:3e:82:e1:d4", "network": {"id": "d2c00f25-1657-4d58-afd2-bf48698d2457", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109276971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4157791638140e8b3d82e46a4e86d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5905b9-ac", "ovs_interfaceid": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Converting VIF {"id": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "address": "fa:16:3e:82:e1:d4", "network": {"id": "d2c00f25-1657-4d58-afd2-bf48698d2457", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109276971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4157791638140e8b3d82e46a4e86d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5905b9-ac", "ovs_interfaceid": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:e1:d4,bridge_name='br-int',has_traffic_filtering=True,id=ff5905b9-ac5a-454f-9259-5a2a368e56e1,network=Network(d2c00f25-1657-4d58-afd2-bf48698d2457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5905b9-ac') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG os_vif [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:e1:d4,bridge_name='br-int',has_traffic_filtering=True,id=ff5905b9-ac5a-454f-9259-5a2a368e56e1,network=Network(d2c00f25-1657-4d58-afd2-bf48698d2457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5905b9-ac') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff5905b9-ac, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff5905b9-ac, col_values=(('external_ids', {'iface-id': 'ff5905b9-ac5a-454f-9259-5a2a368e56e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:e1:d4', 'vm-uuid': '56115fdf-0fdd-4cce-9ae0-6046422f0a56'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:18 user nova-compute[72818]: INFO os_vif [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:e1:d4,bridge_name='br-int',has_traffic_filtering=True,id=ff5905b9-ac5a-454f-9259-5a2a368e56e1,network=Network(d2c00f25-1657-4d58-afd2-bf48698d2457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5905b9-ac')
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:31:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] No VIF found with MAC fa:16:3e:82:e1:d4, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:31:19 user nova-compute[72818]: DEBUG nova.network.neutron [req-974b074e-2536-4c11-bbeb-3ba3e5b2176c req-e0bfa54f-2df6-438c-99ff-169c47ee9503 service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Updated VIF entry in instance network info cache for port ff5905b9-ac5a-454f-9259-5a2a368e56e1. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:31:19 user nova-compute[72818]: DEBUG nova.network.neutron [req-974b074e-2536-4c11-bbeb-3ba3e5b2176c req-e0bfa54f-2df6-438c-99ff-169c47ee9503 service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Updating instance_info_cache with network_info: [{"id": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "address": "fa:16:3e:82:e1:d4", "network": {"id": "d2c00f25-1657-4d58-afd2-bf48698d2457", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109276971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4157791638140e8b3d82e46a4e86d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5905b9-ac", "ovs_interfaceid": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:31:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-974b074e-2536-4c11-bbeb-3ba3e5b2176c req-e0bfa54f-2df6-438c-99ff-169c47ee9503 service nova] Releasing lock "refresh_cache-56115fdf-0fdd-4cce-9ae0-6046422f0a56" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-422423e8-d42e-4b33-aba9-95276eac4449 req-d6c15742-6045-41d4-8098-44b5be8f969e service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Received event network-vif-plugged-ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-422423e8-d42e-4b33-aba9-95276eac4449 req-d6c15742-6045-41d4-8098-44b5be8f969e service nova] Acquiring lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-422423e8-d42e-4b33-aba9-95276eac4449 req-d6c15742-6045-41d4-8098-44b5be8f969e service nova] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-422423e8-d42e-4b33-aba9-95276eac4449 req-d6c15742-6045-41d4-8098-44b5be8f969e service nova] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-422423e8-d42e-4b33-aba9-95276eac4449 req-d6c15742-6045-41d4-8098-44b5be8f969e service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] No waiting events found dispatching network-vif-plugged-ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:31:20 user nova-compute[72818]: WARNING nova.compute.manager [req-422423e8-d42e-4b33-aba9-95276eac4449 req-d6c15742-6045-41d4-8098-44b5be8f969e service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Received unexpected event network-vif-plugged-ff5905b9-ac5a-454f-9259-5a2a368e56e1 for instance with vm_state building and task_state spawning.
Aug 17 21:31:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307882.3544178, 56115fdf-0fdd-4cce-9ae0-6046422f0a56 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:31:22 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] VM Resumed (Lifecycle Event)
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:31:22 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Instance spawned successfully.
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:31:22 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307882.3583355, 56115fdf-0fdd-4cce-9ae0-6046422f0a56 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:31:22 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] VM Started (Lifecycle Event)
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:31:22 user nova-compute[72818]: INFO nova.compute.manager [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Took 5.46 seconds to spawn the instance on the hypervisor.
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:31:22 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-883df5ae-a93c-47d3-b69d-ac2ee2afd403 req-5a5bd84c-8fd7-480f-902f-36208fe01061 service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Received event network-vif-plugged-ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-883df5ae-a93c-47d3-b69d-ac2ee2afd403 req-5a5bd84c-8fd7-480f-902f-36208fe01061 service nova] Acquiring lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-883df5ae-a93c-47d3-b69d-ac2ee2afd403 req-5a5bd84c-8fd7-480f-902f-36208fe01061 service nova] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-883df5ae-a93c-47d3-b69d-ac2ee2afd403 req-5a5bd84c-8fd7-480f-902f-36208fe01061 service nova] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-883df5ae-a93c-47d3-b69d-ac2ee2afd403 req-5a5bd84c-8fd7-480f-902f-36208fe01061 service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] No waiting events found dispatching network-vif-plugged-ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:31:22 user nova-compute[72818]: WARNING nova.compute.manager [req-883df5ae-a93c-47d3-b69d-ac2ee2afd403 req-5a5bd84c-8fd7-480f-902f-36208fe01061 service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Received unexpected event network-vif-plugged-ff5905b9-ac5a-454f-9259-5a2a368e56e1 for instance with vm_state building and task_state spawning.
Aug 17 21:31:22 user nova-compute[72818]: INFO nova.compute.manager [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Took 6.22 seconds to build instance.
Aug 17 21:31:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0b027bda-0e8e-4002-a2a7-9f0bf3353351 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.306s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:31:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:31:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:31:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:31:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:54 user nova-compute[72818]: INFO nova.compute.manager [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Terminating instance
Aug 17 21:31:54 user nova-compute[72818]: DEBUG nova.compute.manager [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:31:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-59518232-9bee-4732-9652-11d2eba039aa req-ce4a6fc5-a9ca-486d-9406-ccc8d0036309 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-unplugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-59518232-9bee-4732-9652-11d2eba039aa req-ce4a6fc5-a9ca-486d-9406-ccc8d0036309 service nova] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-59518232-9bee-4732-9652-11d2eba039aa req-ce4a6fc5-a9ca-486d-9406-ccc8d0036309 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-59518232-9bee-4732-9652-11d2eba039aa req-ce4a6fc5-a9ca-486d-9406-ccc8d0036309 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-59518232-9bee-4732-9652-11d2eba039aa req-ce4a6fc5-a9ca-486d-9406-ccc8d0036309 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] No waiting events found dispatching network-vif-unplugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-59518232-9bee-4732-9652-11d2eba039aa req-ce4a6fc5-a9ca-486d-9406-ccc8d0036309 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-unplugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Instance destroyed successfully.
Aug 17 21:31:55 user nova-compute[72818]: DEBUG nova.objects.instance [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'resources' on Instance uuid d54920e2-56cf-4c58-b66a-a454470c57d6 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-108339640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-108339640',id=26,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:28:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-7pe9h1h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:30:10Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=d54920e2-56cf-4c58-b66a-a454470c57d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "address": "fa:16:3e:4f:f9:56", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87206248-7c", "ovs_interfaceid": "87206248-7cbe-48b7-b3f5-72ffb02ddfac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=87206248-7cbe-48b7-b3f5-72ffb02ddfac,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87206248-7c') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_vif [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=87206248-7cbe-48b7-b3f5-72ffb02ddfac,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87206248-7c') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87206248-7c, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:55 user nova-compute[72818]: INFO os_vif [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=87206248-7cbe-48b7-b3f5-72ffb02ddfac,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87206248-7c')
Aug 17 21:31:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIDTCLwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:31:55 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b766d88a-ab21-4d5e-be97-243a74366a88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4857b571-9e5d-465c-84b1-e1bd9579e979]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:31:55 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:31:55 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:31:55 user nova-compute[72818]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:31:55 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:31:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:31:55 user nova-compute[72818]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 (non-flash)
Aug 17 21:31:55 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:31:55 user nova-compute[72818]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:31:55 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:31:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04dfc5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6'): ({'sdc'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Removing single pathed devices sdc {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[99944431-4968-41eb-8dd5-0decccdee340]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[373db286-5351-4b52-9aca-da232df762c1]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flushing IO for device /dev/sdc {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d7b698-d7e2-4bcf-bb8a-689cecb19d17]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7593fbb4-949d-4e64-990b-a60882299c1b]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOdf3b4f2d-c9cf2d0ee98aed82', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_df3b4f2d', '/dev/disk/by-id/scsi-26339636632643065') {{(pid=83620) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd3826e-92f4-4e32-bd21-bb0b2e9fdd97]: (4, None) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[edab0a2c-c624-4953-850a-8c4dad785748]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4460cb3f-1b7d-4dc4-b21f-9f56c87e1b14]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6, portal: 172.16.0.220,3260]
Aug 17 21:31:55 user nova-compute[72818]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6, portal: 172.16.0.220,3260] successful.
Aug 17 21:31:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea63b9f0-bd73-47dd-8514-101d77b604a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca71d521-b95f-43d6-b861-d0801a8aaf9c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] <== disconnect_volume: return (299ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:31:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Deleting instance files /opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6_del
Aug 17 21:31:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Deletion of /opt/stack/data/nova/instances/d54920e2-56cf-4c58-b66a-a454470c57d6_del complete
Aug 17 21:31:55 user nova-compute[72818]: INFO nova.compute.manager [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 17 21:31:55 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:31:55 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:31:56 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:31:56 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Took 0.47 seconds to deallocate network for instance.
Aug 17 21:31:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-ca2dd521-ef35-4dac-a340-d5f89c74beb7 req-32b99a2b-02b6-4c97-8ee5-200b70df5a1b service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-deleted-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:31:56 user nova-compute[72818]: INFO nova.compute.manager [req-ca2dd521-ef35-4dac-a340-d5f89c74beb7 req-32b99a2b-02b6-4c97-8ee5-200b70df5a1b service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Neutron deleted interface 87206248-7cbe-48b7-b3f5-72ffb02ddfac; detaching it from the instance and deleting it from the info cache
Aug 17 21:31:56 user nova-compute[72818]: DEBUG nova.network.neutron [req-ca2dd521-ef35-4dac-a340-d5f89c74beb7 req-32b99a2b-02b6-4c97-8ee5-200b70df5a1b service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:31:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-ca2dd521-ef35-4dac-a340-d5f89c74beb7 req-32b99a2b-02b6-4c97-8ee5-200b70df5a1b service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Detach interface failed, port_id=87206248-7cbe-48b7-b3f5-72ffb02ddfac, reason: Instance d54920e2-56cf-4c58-b66a-a454470c57d6 could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:31:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:31:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:56 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:31:56 user nova-compute[72818]: INFO nova.compute.claims [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Claim successful on node user
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.compute.manager [req-3fa207d5-895f-4d90-9ac9-3aa9ef3b43af req-7192e9b1-0ed3-41d8-b755-5191499afd20 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3fa207d5-895f-4d90-9ac9-3aa9ef3b43af req-7192e9b1-0ed3-41d8-b755-5191499afd20 service nova] Acquiring lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3fa207d5-895f-4d90-9ac9-3aa9ef3b43af req-7192e9b1-0ed3-41d8-b755-5191499afd20 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3fa207d5-895f-4d90-9ac9-3aa9ef3b43af req-7192e9b1-0ed3-41d8-b755-5191499afd20 service nova] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.compute.manager [req-3fa207d5-895f-4d90-9ac9-3aa9ef3b43af req-7192e9b1-0ed3-41d8-b755-5191499afd20 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] No waiting events found dispatching network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:31:57 user nova-compute[72818]: WARNING nova.compute.manager [req-3fa207d5-895f-4d90-9ac9-3aa9ef3b43af req-7192e9b1-0ed3-41d8-b755-5191499afd20 service nova] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Received unexpected event network-vif-plugged-87206248-7cbe-48b7-b3f5-72ffb02ddfac for instance with vm_state active and task_state deleting.
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.network.neutron [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:31:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:31:57 user nova-compute[72818]: INFO nova.virt.block_device [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Booting with volume f797d56c-78cb-497e-843e-b75c5a86fb43 at /dev/vda
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.policy [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86cb8a969924487b8362d340d0bd31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5202a87dcf64b979cce5074783790f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:31:57 user nova-compute[72818]: INFO nova.compute.manager [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Took 0.80 seconds to detach 1 volumes for instance.
Aug 17 21:31:57 user nova-compute[72818]: DEBUG os_brick.utils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c376424-39b0-49d3-bbc5-5aab2699ef61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a953e150-341a-4507-8e49-72a0397314b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9921b7-a131-4b2a-83c6-500cca91a72a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ba6445-6e35-4dee-a343-88a7ed82fb19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:31:57 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e46d37-67eb-4d33-84fb-59ff7f3970cd]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG os_brick.utils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Updating existing volume attachment record: 4c86d6b2-143d-42d5-8a46-92b7a0cdf2f5 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:57 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Deleted allocations for instance d54920e2-56cf-4c58-b66a-a454470c57d6
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:31:57 user nova-compute[72818]: INFO nova.compute.manager [None req-2f7a230d-63c7-40f5-bb8d-6a1cba8a4630 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Unrescuing
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2f7a230d-63c7-40f5-bb8d-6a1cba8a4630 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2f7a230d-63c7-40f5-bb8d-6a1cba8a4630 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquired lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2f7a230d-63c7-40f5-bb8d-6a1cba8a4630 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-121ca5ec-a861-4a79-9615-2b4dd282acf7 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "d54920e2-56cf-4c58-b66a-a454470c57d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.086s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:57 user nova-compute[72818]: DEBUG nova.network.neutron [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Successfully created port: 09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2f7a230d-63c7-40f5-bb8d-6a1cba8a4630 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updating instance_info_cache with network_info: [{"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2f7a230d-63c7-40f5-bb8d-6a1cba8a4630 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Releasing lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG nova.objects.instance [None req-2f7a230d-63c7-40f5-bb8d-6a1cba8a4630 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'flavor' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG nova.network.neutron [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Successfully updated port: 09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquired lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG nova.network.neutron [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-2d953f2b-a35c-43db-ab91-427aa0d4ea14 req-2aae86e2-b9be-46ba-a0b2-737a3958dfa3 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Received event network-changed-09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-2d953f2b-a35c-43db-ab91-427aa0d4ea14 req-2aae86e2-b9be-46ba-a0b2-737a3958dfa3 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Refreshing instance network info cache due to event network-changed-09fec2e3-cf08-428f-991d-a1d4abad7ca6. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2d953f2b-a35c-43db-ab91-427aa0d4ea14 req-2aae86e2-b9be-46ba-a0b2-737a3958dfa3 service nova] Acquiring lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG nova.network.neutron [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:31:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG nova.network.neutron [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Updating instance_info_cache with network_info: [{"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-09969d4f-8ca5-43bc-98a5-bf2c4f6ddff3 req-5bcf859e-3a0c-4750-9483-38f9d2b53cd0 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-unplugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-09969d4f-8ca5-43bc-98a5-bf2c4f6ddff3 req-5bcf859e-3a0c-4750-9483-38f9d2b53cd0 service nova] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-09969d4f-8ca5-43bc-98a5-bf2c4f6ddff3 req-5bcf859e-3a0c-4750-9483-38f9d2b53cd0 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-09969d4f-8ca5-43bc-98a5-bf2c4f6ddff3 req-5bcf859e-3a0c-4750-9483-38f9d2b53cd0 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-09969d4f-8ca5-43bc-98a5-bf2c4f6ddff3 req-5bcf859e-3a0c-4750-9483-38f9d2b53cd0 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] No waiting events found dispatching network-vif-unplugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:31:59 user nova-compute[72818]: WARNING nova.compute.manager [req-09969d4f-8ca5-43bc-98a5-bf2c4f6ddff3 req-5bcf859e-3a0c-4750-9483-38f9d2b53cd0 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received unexpected event network-vif-unplugged-ff979858-3d61-4234-b7fc-f3f738f6e640 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:31:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-09969d4f-8ca5-43bc-98a5-bf2c4f6ddff3 req-5bcf859e-3a0c-4750-9483-38f9d2b53cd0 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-09969d4f-8ca5-43bc-98a5-bf2c4f6ddff3 req-5bcf859e-3a0c-4750-9483-38f9d2b53cd0 service nova] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-09969d4f-8ca5-43bc-98a5-bf2c4f6ddff3 req-5bcf859e-3a0c-4750-9483-38f9d2b53cd0 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-09969d4f-8ca5-43bc-98a5-bf2c4f6ddff3 req-5bcf859e-3a0c-4750-9483-38f9d2b53cd0 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-09969d4f-8ca5-43bc-98a5-bf2c4f6ddff3 req-5bcf859e-3a0c-4750-9483-38f9d2b53cd0 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] No waiting events found dispatching network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:31:59 user nova-compute[72818]: WARNING nova.compute.manager [req-09969d4f-8ca5-43bc-98a5-bf2c4f6ddff3 req-5bcf859e-3a0c-4750-9483-38f9d2b53cd0 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received unexpected event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:31:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Releasing lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG nova.compute.manager [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Instance network_info: |[{"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2d953f2b-a35c-43db-ab91-427aa0d4ea14 req-2aae86e2-b9be-46ba-a0b2-737a3958dfa3 service nova] Acquired lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG nova.network.neutron [req-2d953f2b-a35c-43db-ab91-427aa0d4ea14 req-2aae86e2-b9be-46ba-a0b2-737a3958dfa3 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Refreshing network info cache for port 09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:31:59 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Instance destroyed successfully.
Aug 17 21:31:59 user nova-compute[72818]: DEBUG nova.network.neutron [req-2d953f2b-a35c-43db-ab91-427aa0d4ea14 req-2aae86e2-b9be-46ba-a0b2-737a3958dfa3 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Updated VIF entry in instance network info cache for port 09fec2e3-cf08-428f-991d-a1d4abad7ca6. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG nova.network.neutron [req-2d953f2b-a35c-43db-ab91-427aa0d4ea14 req-2aae86e2-b9be-46ba-a0b2-737a3958dfa3 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Updating instance_info_cache with network_info: [{"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:31:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2d953f2b-a35c-43db-ab91-427aa0d4ea14 req-2aae86e2-b9be-46ba-a0b2-737a3958dfa3 service nova] Releasing lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:32:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-3d88b8df-063d-460b-bfb5-e9da7c26baa7 req-e67f7e31-da6a-4d43-892a-c55c485fdf3e service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3d88b8df-063d-460b-bfb5-e9da7c26baa7 req-e67f7e31-da6a-4d43-892a-c55c485fdf3e service nova] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3d88b8df-063d-460b-bfb5-e9da7c26baa7 req-e67f7e31-da6a-4d43-892a-c55c485fdf3e service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3d88b8df-063d-460b-bfb5-e9da7c26baa7 req-e67f7e31-da6a-4d43-892a-c55c485fdf3e service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-3d88b8df-063d-460b-bfb5-e9da7c26baa7 req-e67f7e31-da6a-4d43-892a-c55c485fdf3e service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] No waiting events found dispatching network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:01 user nova-compute[72818]: WARNING nova.compute.manager [req-3d88b8df-063d-460b-bfb5-e9da7c26baa7 req-e67f7e31-da6a-4d43-892a-c55c485fdf3e service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received unexpected event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:32:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-3d88b8df-063d-460b-bfb5-e9da7c26baa7 req-e67f7e31-da6a-4d43-892a-c55c485fdf3e service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3d88b8df-063d-460b-bfb5-e9da7c26baa7 req-e67f7e31-da6a-4d43-892a-c55c485fdf3e service nova] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3d88b8df-063d-460b-bfb5-e9da7c26baa7 req-e67f7e31-da6a-4d43-892a-c55c485fdf3e service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3d88b8df-063d-460b-bfb5-e9da7c26baa7 req-e67f7e31-da6a-4d43-892a-c55c485fdf3e service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-3d88b8df-063d-460b-bfb5-e9da7c26baa7 req-e67f7e31-da6a-4d43-892a-c55c485fdf3e service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] No waiting events found dispatching network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:01 user nova-compute[72818]: WARNING nova.compute.manager [req-3d88b8df-063d-460b-bfb5-e9da7c26baa7 req-e67f7e31-da6a-4d43-892a-c55c485fdf3e service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received unexpected event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:32:01 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:32:01 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:32:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for e15761ac-028d-40a9-931d-51ef8b77c1cf due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 21:32:02 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307922.6039705, e15761ac-028d-40a9-931d-51ef8b77c1cf => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:32:02 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] VM Resumed (Lifecycle Event)
Aug 17 21:32:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2f7a230d-63c7-40f5-bb8d-6a1cba8a4630 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:32:02 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 21:32:02 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307922.6052153, e15761ac-028d-40a9-931d-51ef8b77c1cf => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:32:02 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] VM Started (Lifecycle Event)
Aug 17 21:32:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:32:02 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:32:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:32:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:32:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:32:02 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:32:03 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Updating instance_info_cache with network_info: [{"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:32:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-4b43de5d-62c1-4368-8a77-59899ae0b16d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:32:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:32:03 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:32:03 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:32:04 user nova-compute[72818]: WARNING nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Aug 17 21:32:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid b9a0da7f-47b4-467f-944d-49adac671a06 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 827d6c12-deb5-4c05-ad6b-efba319783e9 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 4b43de5d-62c1-4368-8a77-59899ae0b16d {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid ac704cc9-16b1-4bf5-830a-f1ca33c97c6a {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 6c46354a-2316-4703-b7fb-431fa37df1ab {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 61d219ec-0254-41a1-8b53-9177cfe9b585 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 56115fdf-0fdd-4cce-9ae0-6046422f0a56 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "b9a0da7f-47b4-467f-944d-49adac671a06" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "b9a0da7f-47b4-467f-944d-49adac671a06" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "6c46354a-2316-4703-b7fb-431fa37df1ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "61d219ec-0254-41a1-8b53-9177cfe9b585" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "b9a0da7f-47b4-467f-944d-49adac671a06" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:05 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:32:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:32:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquired lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG nova.network.neutron [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'info_cache' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-602871f7-8dc0-4d8d-bad0-c6b1cf9f41d2 req-e5492d6b-1165-4fb6-b36f-b1f8354b1833 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Received event network-changed-24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-602871f7-8dc0-4d8d-bad0-c6b1cf9f41d2 req-e5492d6b-1165-4fb6-b36f-b1f8354b1833 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Refreshing instance network info cache due to event network-changed-24416426-2fb4-4a5c-bd06-d2e3aee656e7. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-602871f7-8dc0-4d8d-bad0-c6b1cf9f41d2 req-e5492d6b-1165-4fb6-b36f-b1f8354b1833 service nova] Acquiring lock "refresh_cache-61d219ec-0254-41a1-8b53-9177cfe9b585" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-602871f7-8dc0-4d8d-bad0-c6b1cf9f41d2 req-e5492d6b-1165-4fb6-b36f-b1f8354b1833 service nova] Acquired lock "refresh_cache-61d219ec-0254-41a1-8b53-9177cfe9b585" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG nova.network.neutron [req-602871f7-8dc0-4d8d-bad0-c6b1cf9f41d2 req-e5492d6b-1165-4fb6-b36f-b1f8354b1833 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Refreshing network info cache for port 24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG nova.objects.instance [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'flavor' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:08 user nova-compute[72818]: INFO nova.compute.manager [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Attaching volume cbf9a25d-02ce-44f9-9cde-6dff6ed329cc to /dev/vdb
Aug 17 21:32:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Updating instance_info_cache with network_info: [{"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Releasing lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG nova.network.neutron [req-602871f7-8dc0-4d8d-bad0-c6b1cf9f41d2 req-e5492d6b-1165-4fb6-b36f-b1f8354b1833 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Updated VIF entry in instance network info cache for port 24416426-2fb4-4a5c-bd06-d2e3aee656e7. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG nova.network.neutron [req-602871f7-8dc0-4d8d-bad0-c6b1cf9f41d2 req-e5492d6b-1165-4fb6-b36f-b1f8354b1833 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Updating instance_info_cache with network_info: [{"id": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "address": "fa:16:3e:e7:5c:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24416426-2f", "ovs_interfaceid": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-602871f7-8dc0-4d8d-bad0-c6b1cf9f41d2 req-e5492d6b-1165-4fb6-b36f-b1f8354b1833 service nova] Releasing lock "refresh_cache-61d219ec-0254-41a1-8b53-9177cfe9b585" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG os_brick.utils [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:08 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance destroyed successfully.
Aug 17 21:32:08 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'resources' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c31dc7-3948-4836-a2ee-05273eb32a91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1630001746',display_name='tempest-AttachVolumeTestJSON-server-1630001746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1630001746',id=29,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUZBvBBpmxnbCIWpS4jBvvAKyP0bQz/vTtdwsd7hEqD4r8z1NOmBaGEjW/K67Sh9o5eiqiRV1WPAPKHJZxGhSDnnIJOt7TtiEiP50gowTOal29LQ0rCa9uTNGAxeT0cnw==',key_name='tempest-keypair-392288452',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d6482e624bb9417598bb26fa0622641d',ramdisk_id='',reservation_id='r-snuu5rli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1086990444',owner_user_name='tempest-AttachVolumeTestJSON-1086990444-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10aff1c23f1041c485ab50735d2dcc12',uuid=e322a0ce-e887-4e29-a5c4-a0da74db3c7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converting VIF {"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG os_vif [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0724e610-181f-459d-89ee-cc8a26397900]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a8f5ce4-c8, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:32:08 user nova-compute[72818]: INFO os_vif [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8')
Aug 17 21:32:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUwgBsdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:32:08 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:32:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[528d6f94-62ed-4f9b-aad4-98d47a122889]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[81645846-b4f6-464c-9eab-121a58e66b6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a87f55c-351d-4aa9-9df2-0de387b5c7d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:32:09 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d77f5f1-9579-49a0-b384-6c2ddf620e0b]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.utils [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updating existing volume attachment record: e10e1436-272c-4c5c-a474-d25403bd637b {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d345ad-7521-4810-a086-8f6fccf71c14]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fa9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a'): ({'sdd'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Removing single pathed devices sdd {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[453e6a16-65d0-4c94-8d9c-9c3a7f59b5a7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c733bfb-8137-4884-b0c8-ad7e43048de7]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Flushing IO for device /dev/sdd {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5ed090-a66c-41a1-a3e1-ba505e9b7322]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.073s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[80beb409-d234-46c6-ad1d-cc7fba2340bb]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9038e2e-46cc-4fc4-b0b6-a00b93b902ba]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:32:09 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Creating image(s)
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Ensure instance console log exists: /opt/stack/data/nova/instances/2e4ea99b-4bfd-4c21-9824-ffa3ad63164a/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Start _get_guest_xml network_info=[{"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '4c86d6b2-143d-42d5-8a46-92b7a0cdf2f5', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZCsrAIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2e4ea99b-4bfd-4c21-9824-ffa3ad63164a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f797d56c-78cb-497e-843e-b75c5a86fb43', 'serial': 'f797d56c-78cb-497e-843e-b75c5a86fb43'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:32:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:32:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZCsrAIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:32:09 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1c7562-88c4-4f69-a13f-325639ee9664]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260]
Aug 17 21:32:09 user nova-compute[72818]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260] successful.
Aug 17 21:32:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e44735a-1a03-41d7-a955-764c3a306aaa]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.522s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] <== disconnect_volume: return (524ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.042s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:32:09 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:32:09 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Start _get_guest_xml network_info=[{"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': 'be8c0ab2-a8b8-48df-bd0d-26cb18d5733c', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUwgBsdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e322a0ce-e887-4e29-a5c4-a0da74db3c7f', 'attached_at': '', 'detached_at': '', 'volume_id': '28aedce7-4232-412f-ba04-bd66b329c60a', 'serial': '28aedce7-4232-412f-ba04-bd66b329c60a'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'numa_topology' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbbfe70-809f-4732-a642-d3ef489d12e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:32:09 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:32:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1251a49b-a655-4269-b1b0-8534d29e2556]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43] added
Aug 17 21:32:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'vcpu_model' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0bf2c6-1dfd-4441-a62c-5c153dcf494d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUwgBsdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:32:09 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3312dad8-0609-493c-96d9-8ca6b74e7fe8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qZCsrAIw {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qZCsrAIw" returned: 0 in 0.034s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2562ee-b8a4-40cb-af81-49d92198c4f3]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qZCsrAIw'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6c50d3-0cdd-4512-82d4-8a4bf94b8a5c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6e630a-23e3-4f7e-8895-35304a9aabec]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[456b36ba-bfde-406c-b928-275faa9b6598]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43, portal: 172.16.0.220,3260]
Aug 17 21:32:09 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43, portal: 172.16.0.220,3260] successful.
Aug 17 21:32:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b66993-e04e-4d0e-8d2b-15e9ab83871e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7497a4-d53f-4506-b984-8bb8ad6f2eb0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6693603b-db80-40e5-a46d-b62bb296dcad]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:32:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZCsrAIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307915.5555904, d54920e2-56cf-4c58-b66a-a454470c57d6 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:32:10 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] VM Stopped (Lifecycle Event)
Aug 17 21:32:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-280ff3c8-b4f8-4099-a892-a409ad30867a None None] [instance: d54920e2-56cf-4c58-b66a-a454470c57d6] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '23263336131646666', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263336131646666', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.286s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:32:10 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:32:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:32:10 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2e56c8-539a-445e-bc4b-98b1bbeb59a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:32:11 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d96c3b0-5bd5-42c8-ade4-4493487b85be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:31:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1592742420',display_name='tempest-ServerActionsTestOtherA-server-1592742420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1592742420',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV/yxdZf0gbz0Oc0hEv4WwXP2jV20fy0LitgWYnfEN52KHQjmeuLO48ZiCuSailjRm1wHuszXDlB837Vche8MvGzjfdhLQW/IYo033/9mpCOWKkYkF4Ly8lZgNbXJbUlw==',key_name='tempest-keypair-570023473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-9abyhwyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:31:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=2e4ea99b-4bfd-4c21-9824-ffa3ad63164a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:89:2d,bridge_name='br-int',has_traffic_filtering=True,id=09fec2e3-cf08-428f-991d-a1d4abad7ca6,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fec2e3-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG nova.objects.instance [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a] added
Aug 17 21:32:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:32:11 user nova-compute[72818]:   <uuid>2e4ea99b-4bfd-4c21-9824-ffa3ad63164a</uuid>
Aug 17 21:32:11 user nova-compute[72818]:   <name>instance-00000021</name>
Aug 17 21:32:11 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:32:11 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:32:11 user nova-compute[72818]:   <metadata>
Aug 17 21:32:11 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:32:11 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:32:11 user nova-compute[72818]:       <nova:name>tempest-ServerActionsTestOtherA-server-1592742420</nova:name>
Aug 17 21:32:11 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:32:09</nova:creationTime>
Aug 17 21:32:11 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:32:11 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:32:11 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:32:11 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:32:11 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:32:11 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:32:11 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:32:11 user nova-compute[72818]:       <nova:owner>
Aug 17 21:32:11 user nova-compute[72818]:         <nova:user uuid="86cb8a969924487b8362d340d0bd31b5">tempest-ServerActionsTestOtherA-1230434837-project-member</nova:user>
Aug 17 21:32:11 user nova-compute[72818]:         <nova:project uuid="d5202a87dcf64b979cce5074783790f9">tempest-ServerActionsTestOtherA-1230434837</nova:project>
Aug 17 21:32:11 user nova-compute[72818]:       </nova:owner>
Aug 17 21:32:11 user nova-compute[72818]:       <nova:ports>
Aug 17 21:32:11 user nova-compute[72818]:         <nova:port uuid="09fec2e3-cf08-428f-991d-a1d4abad7ca6">
Aug 17 21:32:11 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 21:32:11 user nova-compute[72818]:         </nova:port>
Aug 17 21:32:11 user nova-compute[72818]:       </nova:ports>
Aug 17 21:32:11 user nova-compute[72818]:     </nova:instance>
Aug 17 21:32:11 user nova-compute[72818]:   </metadata>
Aug 17 21:32:11 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:32:11 user nova-compute[72818]:     <system>
Aug 17 21:32:11 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:32:11 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:32:11 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:32:11 user nova-compute[72818]:       <entry name="serial">2e4ea99b-4bfd-4c21-9824-ffa3ad63164a</entry>
Aug 17 21:32:11 user nova-compute[72818]:       <entry name="uuid">2e4ea99b-4bfd-4c21-9824-ffa3ad63164a</entry>
Aug 17 21:32:11 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:32:11 user nova-compute[72818]:     </system>
Aug 17 21:32:11 user nova-compute[72818]:   </sysinfo>
Aug 17 21:32:11 user nova-compute[72818]:   <os>
Aug 17 21:32:11 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:32:11 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:32:11 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:32:11 user nova-compute[72818]:   </os>
Aug 17 21:32:11 user nova-compute[72818]:   <features>
Aug 17 21:32:11 user nova-compute[72818]:     <acpi/>
Aug 17 21:32:11 user nova-compute[72818]:     <apic/>
Aug 17 21:32:11 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:32:11 user nova-compute[72818]:   </features>
Aug 17 21:32:11 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:32:11 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:32:11 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:32:11 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:32:11 user nova-compute[72818]:   </clock>
Aug 17 21:32:11 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:32:11 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:32:11 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:32:11 user nova-compute[72818]:   </cpu>
Aug 17 21:32:11 user nova-compute[72818]:   <devices>
Aug 17 21:32:11 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:32:11 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:32:11 user nova-compute[72818]:       <source dev="/dev/sdc"/>
Aug 17 21:32:11 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:32:11 user nova-compute[72818]:       <serial>f797d56c-78cb-497e-843e-b75c5a86fb43</serial>
Aug 17 21:32:11 user nova-compute[72818]:     </disk>
Aug 17 21:32:11 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:32:11 user nova-compute[72818]:       <mac address="fa:16:3e:53:89:2d"/>
Aug 17 21:32:11 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:32:11 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:32:11 user nova-compute[72818]:       <target dev="tap09fec2e3-cf"/>
Aug 17 21:32:11 user nova-compute[72818]:     </interface>
Aug 17 21:32:11 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:32:11 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/2e4ea99b-4bfd-4c21-9824-ffa3ad63164a/console.log" append="off"/>
Aug 17 21:32:11 user nova-compute[72818]:     </serial>
Aug 17 21:32:11 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:32:11 user nova-compute[72818]:     <video>
Aug 17 21:32:11 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:32:11 user nova-compute[72818]:     </video>
Aug 17 21:32:11 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:32:11 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:32:11 user nova-compute[72818]:     </rng>
Aug 17 21:32:11 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:32:11 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:32:11 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:32:11 user nova-compute[72818]:     </memballoon>
Aug 17 21:32:11 user nova-compute[72818]:   </devices>
Aug 17 21:32:11 user nova-compute[72818]: </domain>
Aug 17 21:32:11 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:31:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1592742420',display_name='tempest-ServerActionsTestOtherA-server-1592742420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1592742420',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV/yxdZf0gbz0Oc0hEv4WwXP2jV20fy0LitgWYnfEN52KHQjmeuLO48ZiCuSailjRm1wHuszXDlB837Vche8MvGzjfdhLQW/IYo033/9mpCOWKkYkF4Ly8lZgNbXJbUlw==',key_name='tempest-keypair-570023473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-9abyhwyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:31:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=2e4ea99b-4bfd-4c21-9824-ffa3ad63164a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:89:2d,bridge_name='br-int',has_traffic_filtering=True,id=09fec2e3-cf08-428f-991d-a1d4abad7ca6,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fec2e3-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_vif [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:89:2d,bridge_name='br-int',has_traffic_filtering=True,id=09fec2e3-cf08-428f-991d-a1d4abad7ca6,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fec2e3-cf') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09fec2e3-cf, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09fec2e3-cf, col_values=(('external_ids', {'iface-id': '09fec2e3-cf08-428f-991d-a1d4abad7ca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:89:2d', 'vm-uuid': '2e4ea99b-4bfd-4c21-9824-ffa3ad63164a'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[00af9ea6-8465-47e3-8d8c-fc09b7120a86]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:11 user nova-compute[72818]: INFO os_vif [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:89:2d,bridge_name='br-int',has_traffic_filtering=True,id=09fec2e3-cf08-428f-991d-a1d4abad7ca6,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fec2e3-cf')
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00b60be-ca46-4eb9-9557-7575805d1a3f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUwgBsdR {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUwgBsdR" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bc7447-6bb4-45f1-81e8-d6a3777c3618]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mUwgBsdR'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] No VIF found with MAC fa:16:3e:53:89:2d, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5955e75-a3ba-4fe3-a2a3-ad9e8dd46f35]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e5852e-0494-4483-9705-ed8fe36522ca]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a487fb78-ae83-4b9b-90bd-458ed60b507f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260]
Aug 17 21:32:11 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260] successful.
Aug 17 21:32:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f009dd14-8b08-416a-b38d-4afa18a49ebf]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9a929d-c44b-4dc3-951d-901085d597f1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:11 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.461s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d634bf9-5250-4a85-b3ea-4fb2b3344505]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUwgBsdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:32:11 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Error from libvirt while getting description of instance-0000001d: [Error Code 42] Domain not found: no domain with matching uuid 'e322a0ce-e887-4e29-a5c4-a0da74db3c7f' (instance-0000001d): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e322a0ce-e887-4e29-a5c4-a0da74db3c7f' (instance-0000001d)
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307934.6529534, 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:32:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] VM Resumed (Lifecycle Event)
Aug 17 21:32:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.065s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] <== connect_volume: return (5352ms) {'type': 'block', 'scsi_wwn': '23638393937663734', 'path': '/dev/sdd'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638393937663734', 'path': '/dev/sdd'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-457edfc9-f687-4ddb-bdc1-8c14b9eb1571 req-410408e7-a01d-4e3c-9671-2e18b7b2b412 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Received event network-vif-plugged-09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-457edfc9-f687-4ddb-bdc1-8c14b9eb1571 req-410408e7-a01d-4e3c-9671-2e18b7b2b412 service nova] Acquiring lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-457edfc9-f687-4ddb-bdc1-8c14b9eb1571 req-410408e7-a01d-4e3c-9671-2e18b7b2b412 service nova] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-457edfc9-f687-4ddb-bdc1-8c14b9eb1571 req-410408e7-a01d-4e3c-9671-2e18b7b2b412 service nova] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-457edfc9-f687-4ddb-bdc1-8c14b9eb1571 req-410408e7-a01d-4e3c-9671-2e18b7b2b412 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] No waiting events found dispatching network-vif-plugged-09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:15 user nova-compute[72818]: WARNING nova.compute.manager [req-457edfc9-f687-4ddb-bdc1-8c14b9eb1571 req-410408e7-a01d-4e3c-9671-2e18b7b2b412 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Received unexpected event network-vif-plugged-09fec2e3-cf08-428f-991d-a1d4abad7ca6 for instance with vm_state building and task_state spawning.
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-fb646b30-1c2e-4d6e-8e5f-b1c8451468b1 req-365e7988-bf9b-4da9-a2cb-affb991feadb service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Received event network-vif-plugged-09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fb646b30-1c2e-4d6e-8e5f-b1c8451468b1 req-365e7988-bf9b-4da9-a2cb-affb991feadb service nova] Acquiring lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fb646b30-1c2e-4d6e-8e5f-b1c8451468b1 req-365e7988-bf9b-4da9-a2cb-affb991feadb service nova] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fb646b30-1c2e-4d6e-8e5f-b1c8451468b1 req-365e7988-bf9b-4da9-a2cb-affb991feadb service nova] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-fb646b30-1c2e-4d6e-8e5f-b1c8451468b1 req-365e7988-bf9b-4da9-a2cb-affb991feadb service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] No waiting events found dispatching network-vif-plugged-09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:15 user nova-compute[72818]: WARNING nova.compute.manager [req-fb646b30-1c2e-4d6e-8e5f-b1c8451468b1 req-365e7988-bf9b-4da9-a2cb-affb991feadb service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Received unexpected event network-vif-plugged-09fec2e3-cf08-428f-991d-a1d4abad7ca6 for instance with vm_state building and task_state spawning.
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:32:15 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:32:15 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7619MB free_disk=25.105846405029297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Instance spawned successfully.
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:32:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307934.6536582, 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:32:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] VM Started (Lifecycle Event)
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1630001746',display_name='tempest-AttachVolumeTestJSON-server-1630001746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1630001746',id=29,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUZBvBBpmxnbCIWpS4jBvvAKyP0bQz/vTtdwsd7hEqD4r8z1NOmBaGEjW/K67Sh9o5eiqiRV1WPAPKHJZxGhSDnnIJOt7TtiEiP50gowTOal29LQ0rCa9uTNGAxeT0cnw==',key_name='tempest-keypair-392288452',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d6482e624bb9417598bb26fa0622641d',ramdisk_id='',reservation_id='r-snuu5rli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1086990444',owner_user_name='tempest-AttachVolumeTestJSON-1086990444-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10aff1c23f1041c485ab50735d2dcc12',uuid=e322a0ce-e887-4e29-a5c4-a0da74db3c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converting VIF {"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'pci_devices' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:32:15 user nova-compute[72818]:   <uuid>e322a0ce-e887-4e29-a5c4-a0da74db3c7f</uuid>
Aug 17 21:32:15 user nova-compute[72818]:   <name>instance-0000001d</name>
Aug 17 21:32:15 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:32:15 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:32:15 user nova-compute[72818]:   <metadata>
Aug 17 21:32:15 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:32:15 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:32:15 user nova-compute[72818]:       <nova:name>tempest-AttachVolumeTestJSON-server-1630001746</nova:name>
Aug 17 21:32:15 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:32:09</nova:creationTime>
Aug 17 21:32:15 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:32:15 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:32:15 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:32:15 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:32:15 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:32:15 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:32:15 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:32:15 user nova-compute[72818]:       <nova:owner>
Aug 17 21:32:15 user nova-compute[72818]:         <nova:user uuid="10aff1c23f1041c485ab50735d2dcc12">tempest-AttachVolumeTestJSON-1086990444-project-member</nova:user>
Aug 17 21:32:15 user nova-compute[72818]:         <nova:project uuid="d6482e624bb9417598bb26fa0622641d">tempest-AttachVolumeTestJSON-1086990444</nova:project>
Aug 17 21:32:15 user nova-compute[72818]:       </nova:owner>
Aug 17 21:32:15 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:32:15 user nova-compute[72818]:       <nova:ports>
Aug 17 21:32:15 user nova-compute[72818]:         <nova:port uuid="5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d">
Aug 17 21:32:15 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 21:32:15 user nova-compute[72818]:         </nova:port>
Aug 17 21:32:15 user nova-compute[72818]:       </nova:ports>
Aug 17 21:32:15 user nova-compute[72818]:     </nova:instance>
Aug 17 21:32:15 user nova-compute[72818]:   </metadata>
Aug 17 21:32:15 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:32:15 user nova-compute[72818]:     <system>
Aug 17 21:32:15 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:32:15 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:32:15 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:32:15 user nova-compute[72818]:       <entry name="serial">e322a0ce-e887-4e29-a5c4-a0da74db3c7f</entry>
Aug 17 21:32:15 user nova-compute[72818]:       <entry name="uuid">e322a0ce-e887-4e29-a5c4-a0da74db3c7f</entry>
Aug 17 21:32:15 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:32:15 user nova-compute[72818]:     </system>
Aug 17 21:32:15 user nova-compute[72818]:   </sysinfo>
Aug 17 21:32:15 user nova-compute[72818]:   <os>
Aug 17 21:32:15 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:32:15 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:32:15 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:32:15 user nova-compute[72818]:   </os>
Aug 17 21:32:15 user nova-compute[72818]:   <features>
Aug 17 21:32:15 user nova-compute[72818]:     <acpi/>
Aug 17 21:32:15 user nova-compute[72818]:     <apic/>
Aug 17 21:32:15 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:32:15 user nova-compute[72818]:   </features>
Aug 17 21:32:15 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:32:15 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:32:15 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:32:15 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:32:15 user nova-compute[72818]:   </clock>
Aug 17 21:32:15 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:32:15 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:32:15 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:32:15 user nova-compute[72818]:   </cpu>
Aug 17 21:32:15 user nova-compute[72818]:   <devices>
Aug 17 21:32:15 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:32:15 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:32:15 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk"/>
Aug 17 21:32:15 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:32:15 user nova-compute[72818]:     </disk>
Aug 17 21:32:15 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:32:15 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:32:15 user nova-compute[72818]:       <source dev="/dev/sdd"/>
Aug 17 21:32:15 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:32:15 user nova-compute[72818]:       <serial>28aedce7-4232-412f-ba04-bd66b329c60a</serial>
Aug 17 21:32:15 user nova-compute[72818]:     </disk>
Aug 17 21:32:15 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:32:15 user nova-compute[72818]:       <mac address="fa:16:3e:dc:c2:13"/>
Aug 17 21:32:15 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:32:15 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:32:15 user nova-compute[72818]:       <target dev="tap5a8f5ce4-c8"/>
Aug 17 21:32:15 user nova-compute[72818]:     </interface>
Aug 17 21:32:15 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:32:15 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/console.log" append="off"/>
Aug 17 21:32:15 user nova-compute[72818]:     </serial>
Aug 17 21:32:15 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:32:15 user nova-compute[72818]:     <video>
Aug 17 21:32:15 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:32:15 user nova-compute[72818]:     </video>
Aug 17 21:32:15 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:32:15 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:32:15 user nova-compute[72818]:     </rng>
Aug 17 21:32:15 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:32:15 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:32:15 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:32:15 user nova-compute[72818]:     </memballoon>
Aug 17 21:32:15 user nova-compute[72818]:   </devices>
Aug 17 21:32:15 user nova-compute[72818]: </domain>
Aug 17 21:32:15 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:15 user nova-compute[72818]: INFO nova.compute.manager [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 6c46354a-2316-4703-b7fb-431fa37df1ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e15761ac-028d-40a9-931d-51ef8b77c1cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 61d219ec-0254-41a1-8b53-9177cfe9b585 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 56115fdf-0fdd-4cce-9ae0-6046422f0a56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:15 user nova-compute[72818]: INFO nova.compute.manager [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Took 18.83 seconds to build instance.
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-70370258-97bf-400a-8c76-4504e8fef8c8 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.927s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.334s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:15 user nova-compute[72818]: INFO nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'trusted_certs' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.217s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.786s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Cannot resize image /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:32:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'migration_context' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1630001746',display_name='tempest-AttachVolumeTestJSON-server-1630001746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1630001746',id=29,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUZBvBBpmxnbCIWpS4jBvvAKyP0bQz/vTtdwsd7hEqD4r8z1NOmBaGEjW/K67Sh9o5eiqiRV1WPAPKHJZxGhSDnnIJOt7TtiEiP50gowTOal29LQ0rCa9uTNGAxeT0cnw==',key_name='tempest-keypair-392288452',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d6482e624bb9417598bb26fa0622641d',ramdisk_id='',reservation_id='r-snuu5rli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1086990444',owner_user_name='tempest-AttachVolumeTestJSON-1086990444-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10aff1c23f1041c485ab50735d2dcc12',uuid=e322a0ce-e887-4e29-a5c4-a0da74db3c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converting VIF {"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG os_vif [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a8f5ce4-c8, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a8f5ce4-c8, col_values=(('external_ids', {'iface-id': '5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:c2:13', 'vm-uuid': 'e322a0ce-e887-4e29-a5c4-a0da74db3c7f'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:32:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:16 user nova-compute[72818]: INFO os_vif [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8')
Aug 17 21:32:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-1b1dc3c4-7661-4a5f-8146-ed5fcab3539b req-a9d654c1-d57f-49f9-82b8-320eb63acaaa service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1b1dc3c4-7661-4a5f-8146-ed5fcab3539b req-a9d654c1-d57f-49f9-82b8-320eb63acaaa service nova] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1b1dc3c4-7661-4a5f-8146-ed5fcab3539b req-a9d654c1-d57f-49f9-82b8-320eb63acaaa service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1b1dc3c4-7661-4a5f-8146-ed5fcab3539b req-a9d654c1-d57f-49f9-82b8-320eb63acaaa service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-1b1dc3c4-7661-4a5f-8146-ed5fcab3539b req-a9d654c1-d57f-49f9-82b8-320eb63acaaa service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] No waiting events found dispatching network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:17 user nova-compute[72818]: WARNING nova.compute.manager [req-1b1dc3c4-7661-4a5f-8146-ed5fcab3539b req-a9d654c1-d57f-49f9-82b8-320eb63acaaa service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received unexpected event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d for instance with vm_state stopped and task_state powering-on.
Aug 17 21:32:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-5096efca-15e3-4ef8-910c-67d61e2cf637 req-a17ba5d9-83dd-4082-ad51-f7efb7711595 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5096efca-15e3-4ef8-910c-67d61e2cf637 req-a17ba5d9-83dd-4082-ad51-f7efb7711595 service nova] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5096efca-15e3-4ef8-910c-67d61e2cf637 req-a17ba5d9-83dd-4082-ad51-f7efb7711595 service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5096efca-15e3-4ef8-910c-67d61e2cf637 req-a17ba5d9-83dd-4082-ad51-f7efb7711595 service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-5096efca-15e3-4ef8-910c-67d61e2cf637 req-a17ba5d9-83dd-4082-ad51-f7efb7711595 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] No waiting events found dispatching network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:20 user nova-compute[72818]: WARNING nova.compute.manager [req-5096efca-15e3-4ef8-910c-67d61e2cf637 req-a17ba5d9-83dd-4082-ad51-f7efb7711595 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received unexpected event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d for instance with vm_state stopped and task_state powering-on.
Aug 17 21:32:20 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307940.1239388, e322a0ce-e887-4e29-a5c4-a0da74db3c7f => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:32:20 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] VM Resumed (Lifecycle Event)
Aug 17 21:32:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:32:20 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance rebooted successfully.
Aug 17 21:32:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8d53be61-59f7-4bd2-a260-6c70cab05a95 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:32:20 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 21:32:20 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307940.1260686, e322a0ce-e887-4e29-a5c4-a0da74db3c7f => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:32:20 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] VM Started (Lifecycle Event)
Aug 17 21:32:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "b26cd058-5116-476d-abc9-ee3d273bbe20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:32:21 user nova-compute[72818]: INFO nova.compute.claims [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Claim successful on node user
Aug 17 21:32:21 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKVtlRDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:32:21 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:32:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:32:21 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:32:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:32:21 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:32:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ced468f-9909-42b3-a176-1af1ad089fe2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:32:21 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:21 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:32:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG nova.network.neutron [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f400f6-515e-40b9-8192-e4aba559a96d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc] added
Aug 17 21:32:21 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8d8fb1-9be7-4de4-9723-5cf7b0fd1f91]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d1226f-6fd3-4f9f-9c32-09b68b976dc7]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKVtlRDi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:22 user nova-compute[72818]: INFO nova.virt.block_device [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Booting with volume snapshot 3d4059f2-d668-41e7-a3b3-e470df596f05 at /dev/vda
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKVtlRDi" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4faf29-ffd0-423e-b06a-0fbe27b20dc2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UKVtlRDi'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG nova.policy [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de902559a8794d1a8af9c0efbed4e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92abc22a192a44398dffe75ffae6d270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9efbf4d-f64d-4773-88ab-0f5192fe8add]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f9c08e-7a6e-4034-87e1-85a66881127a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e96bb4c-ffa5-440e-b4c2-608b85f3fd6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc, portal: 172.16.0.220,3260]
Aug 17 21:32:22 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc, portal: 172.16.0.220,3260] successful.
Aug 17 21:32:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f067bc4-af16-4c05-8c94-e3718351575a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b97618-9ff6-4c9d-9a28-033b299ff75e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:32:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:22 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:32:22 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4028d1-f646-4384-b8a0-57e4fe41003c]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKVtlRDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:32:22 user nova-compute[72818]: DEBUG nova.network.neutron [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Successfully created port: c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '26530306635356162', 'path': '/dev/sdf'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530306635356162', 'path': '/dev/sdf'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG nova.objects.instance [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'flavor' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:32:23 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:32:23 user nova-compute[72818]:   <source dev="/dev/sdf"/>
Aug 17 21:32:23 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:32:23 user nova-compute[72818]:   <serial>cbf9a25d-02ce-44f9-9cde-6dff6ed329cc</serial>
Aug 17 21:32:23 user nova-compute[72818]: </disk>
Aug 17 21:32:23 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG nova.network.neutron [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Successfully updated port: c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "refresh_cache-b26cd058-5116-476d-abc9-ee3d273bbe20" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquired lock "refresh_cache-b26cd058-5116-476d-abc9-ee3d273bbe20" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG nova.network.neutron [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] No VIF found with MAC fa:16:3e:d3:6c:07, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-07c6f99f-a5a8-4c3f-a066-873f7315995a req-efb6aedf-7eaa-4928-8d42-82c1d9eead72 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Received event network-changed-c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-07c6f99f-a5a8-4c3f-a066-873f7315995a req-efb6aedf-7eaa-4928-8d42-82c1d9eead72 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Refreshing instance network info cache due to event network-changed-c02459ee-e640-4825-a874-4c4eaa98684a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:32:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-07c6f99f-a5a8-4c3f-a066-873f7315995a req-efb6aedf-7eaa-4928-8d42-82c1d9eead72 service nova] Acquiring lock "refresh_cache-b26cd058-5116-476d-abc9-ee3d273bbe20" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:32:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:32:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-20875ed8-1297-4e54-922a-d90f1e9e1392 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.336s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Updating instance_info_cache with network_info: [{"id": "c02459ee-e640-4825-a874-4c4eaa98684a", "address": "fa:16:3e:6d:02:4e", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02459ee-e6", "ovs_interfaceid": "c02459ee-e640-4825-a874-4c4eaa98684a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:32:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Releasing lock "refresh_cache-b26cd058-5116-476d-abc9-ee3d273bbe20" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:32:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Instance network_info: |[{"id": "c02459ee-e640-4825-a874-4c4eaa98684a", "address": "fa:16:3e:6d:02:4e", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02459ee-e6", "ovs_interfaceid": "c02459ee-e640-4825-a874-4c4eaa98684a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:32:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-07c6f99f-a5a8-4c3f-a066-873f7315995a req-efb6aedf-7eaa-4928-8d42-82c1d9eead72 service nova] Acquired lock "refresh_cache-b26cd058-5116-476d-abc9-ee3d273bbe20" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:32:24 user nova-compute[72818]: DEBUG nova.network.neutron [req-07c6f99f-a5a8-4c3f-a066-873f7315995a req-efb6aedf-7eaa-4928-8d42-82c1d9eead72 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Refreshing network info cache for port c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:32:24 user nova-compute[72818]: DEBUG nova.network.neutron [req-07c6f99f-a5a8-4c3f-a066-873f7315995a req-efb6aedf-7eaa-4928-8d42-82c1d9eead72 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Updated VIF entry in instance network info cache for port c02459ee-e640-4825-a874-4c4eaa98684a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:32:24 user nova-compute[72818]: DEBUG nova.network.neutron [req-07c6f99f-a5a8-4c3f-a066-873f7315995a req-efb6aedf-7eaa-4928-8d42-82c1d9eead72 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Updating instance_info_cache with network_info: [{"id": "c02459ee-e640-4825-a874-4c4eaa98684a", "address": "fa:16:3e:6d:02:4e", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02459ee-e6", "ovs_interfaceid": "c02459ee-e640-4825-a874-4c4eaa98684a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:32:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-07c6f99f-a5a8-4c3f-a066-873f7315995a req-efb6aedf-7eaa-4928-8d42-82c1d9eead72 service nova] Releasing lock "refresh_cache-b26cd058-5116-476d-abc9-ee3d273bbe20" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:32:25 user nova-compute[72818]: INFO nova.compute.manager [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Rescuing
Aug 17 21:32:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:32:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquired lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:32:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updating instance_info_cache with network_info: [{"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Releasing lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-b0b9a0bd-d6ef-4513-a46e-a96769be87b6 req-1aa5328f-4355-4f9c-af55-04b3cf58bd88 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-unplugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b0b9a0bd-d6ef-4513-a46e-a96769be87b6 req-1aa5328f-4355-4f9c-af55-04b3cf58bd88 service nova] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b0b9a0bd-d6ef-4513-a46e-a96769be87b6 req-1aa5328f-4355-4f9c-af55-04b3cf58bd88 service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b0b9a0bd-d6ef-4513-a46e-a96769be87b6 req-1aa5328f-4355-4f9c-af55-04b3cf58bd88 service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-b0b9a0bd-d6ef-4513-a46e-a96769be87b6 req-1aa5328f-4355-4f9c-af55-04b3cf58bd88 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] No waiting events found dispatching network-vif-unplugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:26 user nova-compute[72818]: WARNING nova.compute.manager [req-b0b9a0bd-d6ef-4513-a46e-a96769be87b6 req-1aa5328f-4355-4f9c-af55-04b3cf58bd88 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received unexpected event network-vif-unplugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 for instance with vm_state active and task_state rescuing.
Aug 17 21:32:26 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Instance destroyed successfully.
Aug 17 21:32:26 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Attempting a stable device rescue
Aug 17 21:32:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72818) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Instance directory exists: not creating {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 21:32:26 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Creating image(s)
Aug 17 21:32:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "/opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "/opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "b5f5c5b65f33535beb9e4b1081622a07def4bdb3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "b5f5c5b65f33535beb9e4b1081622a07def4bdb3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3.part --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3.part --force-share --output=json" returned: 0 in 0.195s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.images [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] a7c18874-a3d5-4ba3-88de-1672e9daf200 was qcow2, converting to raw {{(pid=72818) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3.part /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3.converted {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG os_brick.utils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c981bcff-e2be-4951-9bf8-7ae01a30a6c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb63a71b-aeba-4e78-962f-de53de84f4cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b64b47a-c262-46fa-9a99-6eed2106f661]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e236a643-c0e6-4f5e-b874-2bb6be096bc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:32:28 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6a7535-00d1-4e01-bb5e-81c213e0126b]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG os_brick.utils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Updating existing volume attachment record: cce010ef-0765-4b27-afbd-67110d9bce4d {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3.part /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3.converted" returned: 0 in 0.314s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3.converted --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-321b9e47-3991-480d-9f67-2e62793b1ded req-36d7bb6e-6385-4379-bd72-c4a29570f519 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-321b9e47-3991-480d-9f67-2e62793b1ded req-36d7bb6e-6385-4379-bd72-c4a29570f519 service nova] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-321b9e47-3991-480d-9f67-2e62793b1ded req-36d7bb6e-6385-4379-bd72-c4a29570f519 service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-321b9e47-3991-480d-9f67-2e62793b1ded req-36d7bb6e-6385-4379-bd72-c4a29570f519 service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-321b9e47-3991-480d-9f67-2e62793b1ded req-36d7bb6e-6385-4379-bd72-c4a29570f519 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] No waiting events found dispatching network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:28 user nova-compute[72818]: WARNING nova.compute.manager [req-321b9e47-3991-480d-9f67-2e62793b1ded req-36d7bb6e-6385-4379-bd72-c4a29570f519 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received unexpected event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 for instance with vm_state active and task_state rescuing.
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "b5f5c5b65f33535beb9e4b1081622a07def4bdb3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.669s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "b5f5c5b65f33535beb9e4b1081622a07def4bdb3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "b5f5c5b65f33535beb9e4b1081622a07def4bdb3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3 --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3,backing_fmt=raw /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.rescue {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3,backing_fmt=raw /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.rescue" returned: 0 in 0.047s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "b5f5c5b65f33535beb9e4b1081622a07def4bdb3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'migration_context' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Start _get_guest_xml network_info=[{"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "vif_mac": "fa:16:3e:d3:6c:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a7c18874-a3d5-4ba3-88de-1672e9daf200', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': 'e10e1436-272c-4c5c-a474-d25403bd637b', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKVtlRDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '1a747a16-45b2-4d60-aad0-f8bfbc7b0c41', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbf9a25d-02ce-44f9-9cde-6dff6ed329cc', 'serial': 'cbf9a25d-02ce-44f9-9cde-6dff6ed329cc'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'resources' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'numa_topology' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:28 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:32:28 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:32:28 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKVtlRDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:32:29 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:32:29 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:32:29 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1e29de-ee70-4af7-892a-2b50ce10a9ac]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UKVtlRDi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 21:32:29 user nova-compute[72818]: node.name = iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc
Aug 17 21:32:29 user nova-compute[72818]: node.tpgt = -1
Aug 17 21:32:29 user nova-compute[72818]: node.startup = automatic
Aug 17 21:32:29 user nova-compute[72818]: node.leading_login = No
Aug 17 21:32:29 user nova-compute[72818]: iface.iscsi_ifacename = default
Aug 17 21:32:29 user nova-compute[72818]: iface.net_ifacename = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.ipaddress = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.prefix_len = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.hwaddress = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.transport_name = tcp
Aug 17 21:32:29 user nova-compute[72818]: iface.initiatorname = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.state = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.vlan_id = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.vlan_priority = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.vlan_state = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.iface_num = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.mtu = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.port = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.bootproto = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.subnet_mask = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.gateway = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.dhcp_alt_client_id = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.dhcp_dns = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.dhcp_learn_iqn = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.dhcp_vendor_id_state = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.dhcp_vendor_id = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.dhcp_slp_da = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.fragmentation = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.gratuitous_arp = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.incoming_forwarding = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.tos_state = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.tos = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.ttl = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.delayed_ack = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.tcp_nagle = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.tcp_wsf_state = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.tcp_wsf = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.tcp_timer_scale = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.tcp_timestamp = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.redirect = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.def_task_mgmt_timeout = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.header_digest = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.data_digest = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.immediate_data = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.initial_r2t = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.data_seq_inorder = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.data_pdu_inorder = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.erl = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.max_receive_data_len = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.first_burst_len = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.max_outstanding_r2t = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.max_burst_len = 0
Aug 17 21:32:29 user nova-compute[72818]: iface.chap_auth = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.bidi_chap = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.strict_login_compliance = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.discovery_auth = <empty>
Aug 17 21:32:29 user nova-compute[72818]: iface.discovery_logout = <empty>
Aug 17 21:32:29 user nova-compute[72818]: node.discovery_address = <empty>
Aug 17 21:32:29 user nova-compute[72818]: node.discovery_port = 0
Aug 17 21:32:29 user nova-compute[72818]: node.discovery_type = static
Aug 17 21:32:29 user nova-compute[72818]: node.session.initial_cmdsn = 0
Aug 17 21:32:29 user nova-compute[72818]: node.session.initial_login_retry_max = 8
Aug 17 21:32:29 user nova-compute[72818]: node.session.xmit_thread_priority = -20
Aug 17 21:32:29 user nova-compute[72818]: node.session.cmds_max = 128
Aug 17 21:32:29 user nova-compute[72818]: node.session.queue_depth = 32
Aug 17 21:32:29 user nova-compute[72818]: node.session.nr_sessions = 1
Aug 17 21:32:29 user nova-compute[72818]: node.session.auth.authmethod = CHAP
Aug 17 21:32:29 user nova-compute[72818]: node.session.auth.username = UKVtlRDi
Aug 17 21:32:29 user nova-compute[72818]: node.session.auth.password = ***
Aug 17 21:32:29 user nova-compute[72818]: node.session.auth.username_in = <empty>
Aug 17 21:32:29 user nova-compute[72818]: node.session.auth.password_in = <empty>
Aug 17 21:32:29 user nova-compute[72818]: node.session.auth.chap_algs = MD5
Aug 17 21:32:29 user nova-compute[72818]: node.session.timeo.replacement_timeout = 120
Aug 17 21:32:29 user nova-compute[72818]: node.session.err_timeo.abort_timeout = 15
Aug 17 21:32:29 user nova-compute[72818]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 21:32:29 user nova-compute[72818]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 21:32:29 user nova-compute[72818]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 21:32:29 user nova-compute[72818]: node.session.iscsi.FastAbort = Yes
Aug 17 21:32:29 user nova-compute[72818]: node.session.iscsi.InitialR2T = No
Aug 17 21:32:29 user nova-compute[72818]: node.session.iscsi.ImmediateData = Yes
Aug 17 21:32:29 user nova-compute[72818]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 21:32:29 user nova-compute[72818]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 21:32:29 user nova-compute[72818]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 21:32:29 user nova-compute[72818]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 21:32:29 user nova-compute[72818]: node.session.iscsi.MaxConnections = 1
Aug 17 21:32:29 user nova-compute[72818]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 21:32:29 user nova-compute[72818]: node.session.iscsi.ERL = 0
Aug 17 21:32:29 user nova-compute[72818]: node.session.scan = manual
Aug 17 21:32:29 user nova-compute[72818]: node.session.reopen_max = 0
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].address = 172.16.0.220
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].port = 3260
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].startup = manual
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].tcp.window_size = 524288
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].tcp.type_of_service = 0
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].timeo.logout_timeout = 15
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].timeo.login_timeout = 15
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].timeo.auth_timeout = 45
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].iscsi.DataDigest = None
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].iscsi.IFMarker = No
Aug 17 21:32:29 user nova-compute[72818]: node.conn[0].iscsi.OFMarker = No
Aug 17 21:32:29 user nova-compute[72818]: # END RECORD
Aug 17 21:32:29 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.111s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[37db295f-1512-4cad-a675-5b8081a7518e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df4b6df-d2f3-4b6f-bcac-b80d3f470f0e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKVtlRDi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKVtlRDi" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[255b483e-aa8b-4cd7-99f3-5ea6fd721389]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UKVtlRDi'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6c0a2d-c8b5-41d9-870e-cd9a36b098e8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa9a2fa-9e30-4b1c-8e23-2badc35cc684]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:29 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:29 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:29 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:29 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:29 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:32:29 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:29 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:29 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:29 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:29 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:29 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:32:29 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] HCTL ('37', '0', '0', 0) found on session 36 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4b5337-8a1e-4efc-a18d-df2a093d268b]: (4, ('0 0 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Searching for a device in session 36 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKVtlRDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.279s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] <== connect_volume: return (281ms) {'type': 'block', 'scsi_wwn': '26530306635356162', 'path': '/dev/sdf'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530306635356162', 'path': '/dev/sdf'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1442683799',display_name='tempest-ServerStableDeviceRescueTest-server-1442683799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1442683799',id=30,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDwLSGxEukk9sEy04Wrk8OIVuJSzGsPocTfFTy++b8WWPbcEy1LQL4FEUeGxaiUAG+1gM+BfsW0ECiGjCjRoh2wxosjr/MhkzqugFjj2zenjFJHhT+ObJLdTBPH/Erxzw==',key_name='tempest-keypair-286024332',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:28:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40918dc1308241a78b063ebd3c655ab4',ramdisk_id='',reservation_id='r-bflev6ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-749852486',owner_user_name='tempest-ServerStableDeviceRescueTest-749852486-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:30:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c80d8eb201914d10b31bb83b4a37b326',uuid=1a747a16-45b2-4d60-aad0-f8bfbc7b0c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "vif_mac": "fa:16:3e:d3:6c:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Converting VIF {"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "vif_mac": "fa:16:3e:d3:6c:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:6c:07,bridge_name='br-int',has_traffic_filtering=True,id=758c519d-4502-4a83-9900-5cdfbc22c4f3,network=Network(763d2138-168e-4f11-823a-4167572838f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c519d-45') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:32:29 user nova-compute[72818]:   <uuid>1a747a16-45b2-4d60-aad0-f8bfbc7b0c41</uuid>
Aug 17 21:32:29 user nova-compute[72818]:   <name>instance-0000001e</name>
Aug 17 21:32:29 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:32:29 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:32:29 user nova-compute[72818]:   <metadata>
Aug 17 21:32:29 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:32:29 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:32:29 user nova-compute[72818]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1442683799</nova:name>
Aug 17 21:32:29 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:32:28</nova:creationTime>
Aug 17 21:32:29 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:32:29 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:32:29 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:32:29 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:32:29 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:32:29 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:32:29 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:32:29 user nova-compute[72818]:       <nova:owner>
Aug 17 21:32:29 user nova-compute[72818]:         <nova:user uuid="c80d8eb201914d10b31bb83b4a37b326">tempest-ServerStableDeviceRescueTest-749852486-project-member</nova:user>
Aug 17 21:32:29 user nova-compute[72818]:         <nova:project uuid="40918dc1308241a78b063ebd3c655ab4">tempest-ServerStableDeviceRescueTest-749852486</nova:project>
Aug 17 21:32:29 user nova-compute[72818]:       </nova:owner>
Aug 17 21:32:29 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:32:29 user nova-compute[72818]:       <nova:ports>
Aug 17 21:32:29 user nova-compute[72818]:         <nova:port uuid="758c519d-4502-4a83-9900-5cdfbc22c4f3">
Aug 17 21:32:29 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 21:32:29 user nova-compute[72818]:         </nova:port>
Aug 17 21:32:29 user nova-compute[72818]:       </nova:ports>
Aug 17 21:32:29 user nova-compute[72818]:     </nova:instance>
Aug 17 21:32:29 user nova-compute[72818]:   </metadata>
Aug 17 21:32:29 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:32:29 user nova-compute[72818]:     <system>
Aug 17 21:32:29 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:32:29 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:32:29 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:32:29 user nova-compute[72818]:       <entry name="serial">1a747a16-45b2-4d60-aad0-f8bfbc7b0c41</entry>
Aug 17 21:32:29 user nova-compute[72818]:       <entry name="uuid">1a747a16-45b2-4d60-aad0-f8bfbc7b0c41</entry>
Aug 17 21:32:29 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:32:29 user nova-compute[72818]:     </system>
Aug 17 21:32:29 user nova-compute[72818]:   </sysinfo>
Aug 17 21:32:29 user nova-compute[72818]:   <os>
Aug 17 21:32:29 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:32:29 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:32:29 user nova-compute[72818]:   </os>
Aug 17 21:32:29 user nova-compute[72818]:   <features>
Aug 17 21:32:29 user nova-compute[72818]:     <acpi/>
Aug 17 21:32:29 user nova-compute[72818]:     <apic/>
Aug 17 21:32:29 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:32:29 user nova-compute[72818]:   </features>
Aug 17 21:32:29 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:32:29 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:32:29 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:32:29 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:32:29 user nova-compute[72818]:   </clock>
Aug 17 21:32:29 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:32:29 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:32:29 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:32:29 user nova-compute[72818]:   </cpu>
Aug 17 21:32:29 user nova-compute[72818]:   <devices>
Aug 17 21:32:29 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:32:29 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:32:29 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk"/>
Aug 17 21:32:29 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:32:29 user nova-compute[72818]:     </disk>
Aug 17 21:32:29 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:32:29 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:32:29 user nova-compute[72818]:       <source dev="/dev/sdf"/>
Aug 17 21:32:29 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:32:29 user nova-compute[72818]:       <serial>cbf9a25d-02ce-44f9-9cde-6dff6ed329cc</serial>
Aug 17 21:32:29 user nova-compute[72818]:     </disk>
Aug 17 21:32:29 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:32:29 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:32:29 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.rescue"/>
Aug 17 21:32:29 user nova-compute[72818]:       <target dev="vdc" bus="virtio"/>
Aug 17 21:32:29 user nova-compute[72818]:       <boot order="1"/>
Aug 17 21:32:29 user nova-compute[72818]:     </disk>
Aug 17 21:32:29 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:32:29 user nova-compute[72818]:       <mac address="fa:16:3e:d3:6c:07"/>
Aug 17 21:32:29 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:32:29 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:32:29 user nova-compute[72818]:       <target dev="tap758c519d-45"/>
Aug 17 21:32:29 user nova-compute[72818]:     </interface>
Aug 17 21:32:29 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:32:29 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/console.log" append="off"/>
Aug 17 21:32:29 user nova-compute[72818]:     </serial>
Aug 17 21:32:29 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:32:29 user nova-compute[72818]:     <video>
Aug 17 21:32:29 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:32:29 user nova-compute[72818]:     </video>
Aug 17 21:32:29 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:32:29 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:32:29 user nova-compute[72818]:     </rng>
Aug 17 21:32:29 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:32:29 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:32:29 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:32:29 user nova-compute[72818]:     </memballoon>
Aug 17 21:32:29 user nova-compute[72818]:   </devices>
Aug 17 21:32:29 user nova-compute[72818]: </domain>
Aug 17 21:32:29 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:32:29 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Instance destroyed successfully.
Aug 17 21:32:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:32:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] No VIF found with MAC fa:16:3e:d3:6c:07, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:32:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-9cea7536-0a80-4ecd-9cc4-452c2d91ddbf req-0e22a4c3-e107-4115-838d-a7ade1957668 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9cea7536-0a80-4ecd-9cc4-452c2d91ddbf req-0e22a4c3-e107-4115-838d-a7ade1957668 service nova] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9cea7536-0a80-4ecd-9cc4-452c2d91ddbf req-0e22a4c3-e107-4115-838d-a7ade1957668 service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9cea7536-0a80-4ecd-9cc4-452c2d91ddbf req-0e22a4c3-e107-4115-838d-a7ade1957668 service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-9cea7536-0a80-4ecd-9cc4-452c2d91ddbf req-0e22a4c3-e107-4115-838d-a7ade1957668 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] No waiting events found dispatching network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:30 user nova-compute[72818]: WARNING nova.compute.manager [req-9cea7536-0a80-4ecd-9cc4-452c2d91ddbf req-0e22a4c3-e107-4115-838d-a7ade1957668 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received unexpected event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 for instance with vm_state active and task_state rescuing.
Aug 17 21:32:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 21:32:33 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307953.0058851, 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:32:33 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] VM Resumed (Lifecycle Event)
Aug 17 21:32:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-be704411-4b6d-49d3-92c7-05da2dcaec75 req-c74eb6ed-5c4e-43b0-a7a2-4407101e57a5 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-be704411-4b6d-49d3-92c7-05da2dcaec75 req-c74eb6ed-5c4e-43b0-a7a2-4407101e57a5 service nova] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-be704411-4b6d-49d3-92c7-05da2dcaec75 req-c74eb6ed-5c4e-43b0-a7a2-4407101e57a5 service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-be704411-4b6d-49d3-92c7-05da2dcaec75 req-c74eb6ed-5c4e-43b0-a7a2-4407101e57a5 service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-be704411-4b6d-49d3-92c7-05da2dcaec75 req-c74eb6ed-5c4e-43b0-a7a2-4407101e57a5 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] No waiting events found dispatching network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:33 user nova-compute[72818]: WARNING nova.compute.manager [req-be704411-4b6d-49d3-92c7-05da2dcaec75 req-c74eb6ed-5c4e-43b0-a7a2-4407101e57a5 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received unexpected event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 for instance with vm_state active and task_state rescuing.
Aug 17 21:32:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-7e7bbc0f-1820-4806-b675-57ab979b240f tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:32:33 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 21:32:33 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307953.0074053, 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:32:33 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] VM Started (Lifecycle Event)
Aug 17 21:32:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:32:33 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 21:32:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:32:40 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Creating image(s)
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Ensure instance console log exists: /opt/stack/data/nova/instances/b26cd058-5116-476d-abc9-ee3d273bbe20/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Start _get_guest_xml network_info=[{"id": "c02459ee-e640-4825-a874-4c4eaa98684a", "address": "fa:16:3e:6d:02:4e", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02459ee-e6", "ovs_interfaceid": "c02459ee-e640-4825-a874-4c4eaa98684a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T21:32:10Z,direct_url=<?>,disk_format='qcow2',id=cc844951-044e-428e-824a-ed248934c5e9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-957381416',owner='92abc22a192a44398dffe75ffae6d270',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T21:32:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'cce010ef-0765-4b27-afbd-67110d9bce4d', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDuohMRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b26cd058-5116-476d-abc9-ee3d273bbe20', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6a63abf-7b15-43a4-acca-5a969dda603b', 'serial': 'b6a63abf-7b15-43a4-acca-5a969dda603b'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:32:40 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:32:40 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T21:32:10Z,direct_url=<?>,disk_format='qcow2',id=cc844951-044e-428e-824a-ed248934c5e9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-957381416',owner='92abc22a192a44398dffe75ffae6d270',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T21:32:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDuohMRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:32:40 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:32:40 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:32:40 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5b4ecc-fdc2-49d1-8e98-32851718a7d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:32:40 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ccdfcd-212a-4d5e-b6b5-4f7b37f26ad0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b] added
Aug 17 21:32:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa591af-5d52-4e23-a412-a85755713a7a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5cfce0-cf8f-4b4f-9f55-b5fea8ace8c0]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDuohMRn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDuohMRn" returned: 0 in 0.067s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4853ae50-0a5d-42fd-99b1-2289dccae9d1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kDuohMRn'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9992d6-641d-4e03-86d5-dfe8238b17cd]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7785654d-8518-40be-8f4d-97860b35a06c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:40 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:40 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:40 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:40 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:40 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:32:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:40 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:40 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:40 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:40 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:40 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:32:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:32:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[541fcb41-2f36-4a07-ad25-eaf843859816]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b, portal: 172.16.0.220,3260]
Aug 17 21:32:41 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b, portal: 172.16.0.220,3260] successful.
Aug 17 21:32:41 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c03746-2b13-4126-bf0a-361213421afe]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3177ff3-5897-45b7-b956-5581a32d1a67]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:41 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:41 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:41 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:41 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:41 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:32:41 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:32:41 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:32:41 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:32:41 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:32:41 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:32:41 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:32:41 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:32:41 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:32:41 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[250f406e-1dd2-46c7-9cb1-21f4b789cc72]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDuohMRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:32:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23831653632626438', 'path': '/dev/sdg'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831653632626438', 'path': '/dev/sdg'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-16053808',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-16053808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-16053808',id=34,image_ref='cc844951-044e-428e-824a-ed248934c5e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpWPhhXKx27u1pBMgcijThxcrpYnzAwhp7gmBunj6AuwfquKr/cmGhROfmyzA/rIOun4oc5ZWLTUDU4nuxQhgP0j2u0+lxWWaG9Py7DiMx0BCcElRxVB/5KLN1DotHhnA==',key_name='tempest-keypair-1882177992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-0a7k203n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-973058317',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=b26cd058-5116-476d-abc9-ee3d273bbe20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c02459ee-e640-4825-a874-4c4eaa98684a", "address": "fa:16:3e:6d:02:4e", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02459ee-e6", "ovs_interfaceid": "c02459ee-e640-4825-a874-4c4eaa98684a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "c02459ee-e640-4825-a874-4c4eaa98684a", "address": "fa:16:3e:6d:02:4e", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02459ee-e6", "ovs_interfaceid": "c02459ee-e640-4825-a874-4c4eaa98684a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:02:4e,bridge_name='br-int',has_traffic_filtering=True,id=c02459ee-e640-4825-a874-4c4eaa98684a,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02459ee-e6') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG nova.objects.instance [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lazy-loading 'pci_devices' on Instance uuid b26cd058-5116-476d-abc9-ee3d273bbe20 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:32:42 user nova-compute[72818]:   <uuid>b26cd058-5116-476d-abc9-ee3d273bbe20</uuid>
Aug 17 21:32:42 user nova-compute[72818]:   <name>instance-00000022</name>
Aug 17 21:32:42 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:32:42 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:32:42 user nova-compute[72818]:   <metadata>
Aug 17 21:32:42 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:32:42 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:32:42 user nova-compute[72818]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-16053808</nova:name>
Aug 17 21:32:42 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:32:40</nova:creationTime>
Aug 17 21:32:42 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:32:42 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:32:42 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:32:42 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:32:42 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:32:42 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:32:42 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:32:42 user nova-compute[72818]:       <nova:owner>
Aug 17 21:32:42 user nova-compute[72818]:         <nova:user uuid="de902559a8794d1a8af9c0efbed4e38a">tempest-TestVolumeBootPattern-973058317-project-member</nova:user>
Aug 17 21:32:42 user nova-compute[72818]:         <nova:project uuid="92abc22a192a44398dffe75ffae6d270">tempest-TestVolumeBootPattern-973058317</nova:project>
Aug 17 21:32:42 user nova-compute[72818]:       </nova:owner>
Aug 17 21:32:42 user nova-compute[72818]:       <nova:root type="image" uuid="cc844951-044e-428e-824a-ed248934c5e9"/>
Aug 17 21:32:42 user nova-compute[72818]:       <nova:ports>
Aug 17 21:32:42 user nova-compute[72818]:         <nova:port uuid="c02459ee-e640-4825-a874-4c4eaa98684a">
Aug 17 21:32:42 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 21:32:42 user nova-compute[72818]:         </nova:port>
Aug 17 21:32:42 user nova-compute[72818]:       </nova:ports>
Aug 17 21:32:42 user nova-compute[72818]:     </nova:instance>
Aug 17 21:32:42 user nova-compute[72818]:   </metadata>
Aug 17 21:32:42 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:32:42 user nova-compute[72818]:     <system>
Aug 17 21:32:42 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:32:42 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:32:42 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:32:42 user nova-compute[72818]:       <entry name="serial">b26cd058-5116-476d-abc9-ee3d273bbe20</entry>
Aug 17 21:32:42 user nova-compute[72818]:       <entry name="uuid">b26cd058-5116-476d-abc9-ee3d273bbe20</entry>
Aug 17 21:32:42 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:32:42 user nova-compute[72818]:     </system>
Aug 17 21:32:42 user nova-compute[72818]:   </sysinfo>
Aug 17 21:32:42 user nova-compute[72818]:   <os>
Aug 17 21:32:42 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:32:42 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:32:42 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:32:42 user nova-compute[72818]:   </os>
Aug 17 21:32:42 user nova-compute[72818]:   <features>
Aug 17 21:32:42 user nova-compute[72818]:     <acpi/>
Aug 17 21:32:42 user nova-compute[72818]:     <apic/>
Aug 17 21:32:42 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:32:42 user nova-compute[72818]:   </features>
Aug 17 21:32:42 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:32:42 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:32:42 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:32:42 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:32:42 user nova-compute[72818]:   </clock>
Aug 17 21:32:42 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:32:42 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:32:42 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:32:42 user nova-compute[72818]:   </cpu>
Aug 17 21:32:42 user nova-compute[72818]:   <devices>
Aug 17 21:32:42 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:32:42 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:32:42 user nova-compute[72818]:       <source dev="/dev/sdg"/>
Aug 17 21:32:42 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:32:42 user nova-compute[72818]:       <serial>b6a63abf-7b15-43a4-acca-5a969dda603b</serial>
Aug 17 21:32:42 user nova-compute[72818]:     </disk>
Aug 17 21:32:42 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:32:42 user nova-compute[72818]:       <mac address="fa:16:3e:6d:02:4e"/>
Aug 17 21:32:42 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:32:42 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:32:42 user nova-compute[72818]:       <target dev="tapc02459ee-e6"/>
Aug 17 21:32:42 user nova-compute[72818]:     </interface>
Aug 17 21:32:42 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:32:42 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/b26cd058-5116-476d-abc9-ee3d273bbe20/console.log" append="off"/>
Aug 17 21:32:42 user nova-compute[72818]:     </serial>
Aug 17 21:32:42 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:32:42 user nova-compute[72818]:     <video>
Aug 17 21:32:42 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:32:42 user nova-compute[72818]:     </video>
Aug 17 21:32:42 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:32:42 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:32:42 user nova-compute[72818]:     </rng>
Aug 17 21:32:42 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:32:42 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:32:42 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:32:42 user nova-compute[72818]:     </memballoon>
Aug 17 21:32:42 user nova-compute[72818]:   </devices>
Aug 17 21:32:42 user nova-compute[72818]: </domain>
Aug 17 21:32:42 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-16053808',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-16053808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-16053808',id=34,image_ref='cc844951-044e-428e-824a-ed248934c5e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpWPhhXKx27u1pBMgcijThxcrpYnzAwhp7gmBunj6AuwfquKr/cmGhROfmyzA/rIOun4oc5ZWLTUDU4nuxQhgP0j2u0+lxWWaG9Py7DiMx0BCcElRxVB/5KLN1DotHhnA==',key_name='tempest-keypair-1882177992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-0a7k203n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-973058317',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=b26cd058-5116-476d-abc9-ee3d273bbe20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c02459ee-e640-4825-a874-4c4eaa98684a", "address": "fa:16:3e:6d:02:4e", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02459ee-e6", "ovs_interfaceid": "c02459ee-e640-4825-a874-4c4eaa98684a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "c02459ee-e640-4825-a874-4c4eaa98684a", "address": "fa:16:3e:6d:02:4e", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02459ee-e6", "ovs_interfaceid": "c02459ee-e640-4825-a874-4c4eaa98684a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:02:4e,bridge_name='br-int',has_traffic_filtering=True,id=c02459ee-e640-4825-a874-4c4eaa98684a,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02459ee-e6') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG os_vif [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:02:4e,bridge_name='br-int',has_traffic_filtering=True,id=c02459ee-e640-4825-a874-4c4eaa98684a,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02459ee-e6') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc02459ee-e6, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc02459ee-e6, col_values=(('external_ids', {'iface-id': 'c02459ee-e640-4825-a874-4c4eaa98684a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:02:4e', 'vm-uuid': 'b26cd058-5116-476d-abc9-ee3d273bbe20'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:42 user nova-compute[72818]: INFO os_vif [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:02:4e,bridge_name='br-int',has_traffic_filtering=True,id=c02459ee-e640-4825-a874-4c4eaa98684a,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02459ee-e6')
Aug 17 21:32:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:32:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] No VIF found with MAC fa:16:3e:6d:02:4e, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:32:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-f209427e-cbdd-4a43-bd5a-3d2462c2dcb7 req-d1defcb9-967a-430c-9ff5-fa8593101930 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Received event network-vif-plugged-c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f209427e-cbdd-4a43-bd5a-3d2462c2dcb7 req-d1defcb9-967a-430c-9ff5-fa8593101930 service nova] Acquiring lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f209427e-cbdd-4a43-bd5a-3d2462c2dcb7 req-d1defcb9-967a-430c-9ff5-fa8593101930 service nova] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f209427e-cbdd-4a43-bd5a-3d2462c2dcb7 req-d1defcb9-967a-430c-9ff5-fa8593101930 service nova] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-f209427e-cbdd-4a43-bd5a-3d2462c2dcb7 req-d1defcb9-967a-430c-9ff5-fa8593101930 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] No waiting events found dispatching network-vif-plugged-c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:43 user nova-compute[72818]: WARNING nova.compute.manager [req-f209427e-cbdd-4a43-bd5a-3d2462c2dcb7 req-d1defcb9-967a-430c-9ff5-fa8593101930 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Received unexpected event network-vif-plugged-c02459ee-e640-4825-a874-4c4eaa98684a for instance with vm_state building and task_state spawning.
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307965.561932, b26cd058-5116-476d-abc9-ee3d273bbe20 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:32:45 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] VM Resumed (Lifecycle Event)
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:32:45 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Instance spawned successfully.
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:32:45 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692307965.563085, b26cd058-5116-476d-abc9-ee3d273bbe20 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:32:45 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] VM Started (Lifecycle Event)
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:45 user nova-compute[72818]: INFO nova.compute.manager [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:32:45 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:32:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "6c46354a-2316-4703-b7fb-431fa37df1ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:45 user nova-compute[72818]: INFO nova.compute.manager [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Terminating instance
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-30c51722-6ef3-4dc7-8d02-1b1d74bfe2fa req-5a1d5e14-faf4-4910-85c6-2ee302223aae service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Received event network-vif-plugged-c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-30c51722-6ef3-4dc7-8d02-1b1d74bfe2fa req-5a1d5e14-faf4-4910-85c6-2ee302223aae service nova] Acquiring lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-30c51722-6ef3-4dc7-8d02-1b1d74bfe2fa req-5a1d5e14-faf4-4910-85c6-2ee302223aae service nova] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-30c51722-6ef3-4dc7-8d02-1b1d74bfe2fa req-5a1d5e14-faf4-4910-85c6-2ee302223aae service nova] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-30c51722-6ef3-4dc7-8d02-1b1d74bfe2fa req-5a1d5e14-faf4-4910-85c6-2ee302223aae service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] No waiting events found dispatching network-vif-plugged-c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:45 user nova-compute[72818]: WARNING nova.compute.manager [req-30c51722-6ef3-4dc7-8d02-1b1d74bfe2fa req-5a1d5e14-faf4-4910-85c6-2ee302223aae service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Received unexpected event network-vif-plugged-c02459ee-e640-4825-a874-4c4eaa98684a for instance with vm_state active and task_state None.
Aug 17 21:32:45 user nova-compute[72818]: INFO nova.compute.manager [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Took 24.49 seconds to build instance.
Aug 17 21:32:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-555d7f52-459b-4b2d-85ac-314d8122741a tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.596s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG nova.compute.manager [req-fc0c86cb-32d4-4023-9762-59c1448e1154 req-754ac973-ec14-439f-9972-70aa4cccbdec service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Received event network-vif-unplugged-281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc0c86cb-32d4-4023-9762-59c1448e1154 req-754ac973-ec14-439f-9972-70aa4cccbdec service nova] Acquiring lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc0c86cb-32d4-4023-9762-59c1448e1154 req-754ac973-ec14-439f-9972-70aa4cccbdec service nova] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fc0c86cb-32d4-4023-9762-59c1448e1154 req-754ac973-ec14-439f-9972-70aa4cccbdec service nova] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG nova.compute.manager [req-fc0c86cb-32d4-4023-9762-59c1448e1154 req-754ac973-ec14-439f-9972-70aa4cccbdec service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] No waiting events found dispatching network-vif-unplugged-281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG nova.compute.manager [req-fc0c86cb-32d4-4023-9762-59c1448e1154 req-754ac973-ec14-439f-9972-70aa4cccbdec service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Received event network-vif-unplugged-281c4ad0-fcb8-4031-8774-3e1f766ba8be for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:46 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Instance destroyed successfully.
Aug 17 21:32:46 user nova-compute[72818]: DEBUG nova.objects.instance [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'resources' on Instance uuid 6c46354a-2316-4703-b7fb-431fa37df1ab {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-371834473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-371834473',id=24,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:23:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-54xrhgjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:25:19Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=6c46354a-2316-4703-b7fb-431fa37df1ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "address": "fa:16:3e:a5:cc:bb", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4ad0-fc", "ovs_interfaceid": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "address": "fa:16:3e:a5:cc:bb", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4ad0-fc", "ovs_interfaceid": "281c4ad0-fcb8-4031-8774-3e1f766ba8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:bb,bridge_name='br-int',has_traffic_filtering=True,id=281c4ad0-fcb8-4031-8774-3e1f766ba8be,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4ad0-fc') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG os_vif [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:bb,bridge_name='br-int',has_traffic_filtering=True,id=281c4ad0-fcb8-4031-8774-3e1f766ba8be,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4ad0-fc') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap281c4ad0-fc, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:32:46 user nova-compute[72818]: INFO os_vif [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:bb,bridge_name='br-int',has_traffic_filtering=True,id=281c4ad0-fcb8-4031-8774-3e1f766ba8be,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4ad0-fc')
Aug 17 21:32:46 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Deleting instance files /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab_del
Aug 17 21:32:46 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Deletion of /opt/stack/data/nova/instances/6c46354a-2316-4703-b7fb-431fa37df1ab_del complete
Aug 17 21:32:46 user nova-compute[72818]: INFO nova.compute.manager [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 17 21:32:46 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:32:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:47 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:32:47 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Took 0.46 seconds to deallocate network for instance.
Aug 17 21:32:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:47 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:32:47 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:32:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:47 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Deleted allocations for instance 6c46354a-2316-4703-b7fb-431fa37df1ab
Aug 17 21:32:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-26b28f0b-d7ae-482a-a622-10fdcd5493d1 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.035s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-1996c2d1-ac30-4993-b98e-1349523d816e req-28d13e91-3f30-4e5e-a56c-1147bd76cf66 service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Received event network-vif-deleted-281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-e97da030-faa9-4813-acc5-2a5a533221c4 req-443cd214-d74a-48d6-8994-f8d512cf4b27 service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Received event network-vif-plugged-281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:32:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e97da030-faa9-4813-acc5-2a5a533221c4 req-443cd214-d74a-48d6-8994-f8d512cf4b27 service nova] Acquiring lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:32:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e97da030-faa9-4813-acc5-2a5a533221c4 req-443cd214-d74a-48d6-8994-f8d512cf4b27 service nova] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:32:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e97da030-faa9-4813-acc5-2a5a533221c4 req-443cd214-d74a-48d6-8994-f8d512cf4b27 service nova] Lock "6c46354a-2316-4703-b7fb-431fa37df1ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:32:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-e97da030-faa9-4813-acc5-2a5a533221c4 req-443cd214-d74a-48d6-8994-f8d512cf4b27 service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] No waiting events found dispatching network-vif-plugged-281c4ad0-fcb8-4031-8774-3e1f766ba8be {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:32:48 user nova-compute[72818]: WARNING nova.compute.manager [req-e97da030-faa9-4813-acc5-2a5a533221c4 req-443cd214-d74a-48d6-8994-f8d512cf4b27 service nova] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Received unexpected event network-vif-plugged-281c4ad0-fcb8-4031-8774-3e1f766ba8be for instance with vm_state deleted and task_state None.
Aug 17 21:32:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:32:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:01 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692307966.6438787, 6c46354a-2316-4703-b7fb-431fa37df1ab => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:33:01 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] VM Stopped (Lifecycle Event)
Aug 17 21:33:01 user nova-compute[72818]: DEBUG nova.compute.manager [None req-bc71a295-2963-42da-a0f0-10cd78399f71 None None] [instance: 6c46354a-2316-4703-b7fb-431fa37df1ab] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:33:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:05 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:33:05 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:33:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:33:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:33:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:33:05 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:33:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:06 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Updating instance_info_cache with network_info: [{"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:33:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-94abd430-6fc8-4c31-9dc8-c44df16ed4a3" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:33:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:33:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:33:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:33:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:33:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:33:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:33:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:33:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:33:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-030dbf2c-b871-42d9-803b-3d3dd790257e req-fb7b43f0-f054-4917-b471-56377ede75aa service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Received event network-changed-ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:33:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-030dbf2c-b871-42d9-803b-3d3dd790257e req-fb7b43f0-f054-4917-b471-56377ede75aa service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Refreshing instance network info cache due to event network-changed-ff5905b9-ac5a-454f-9259-5a2a368e56e1. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:33:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-030dbf2c-b871-42d9-803b-3d3dd790257e req-fb7b43f0-f054-4917-b471-56377ede75aa service nova] Acquiring lock "refresh_cache-56115fdf-0fdd-4cce-9ae0-6046422f0a56" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:33:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-030dbf2c-b871-42d9-803b-3d3dd790257e req-fb7b43f0-f054-4917-b471-56377ede75aa service nova] Acquired lock "refresh_cache-56115fdf-0fdd-4cce-9ae0-6046422f0a56" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:33:07 user nova-compute[72818]: DEBUG nova.network.neutron [req-030dbf2c-b871-42d9-803b-3d3dd790257e req-fb7b43f0-f054-4917-b471-56377ede75aa service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Refreshing network info cache for port ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:33:07 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:33:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG nova.network.neutron [req-030dbf2c-b871-42d9-803b-3d3dd790257e req-fb7b43f0-f054-4917-b471-56377ede75aa service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Updated VIF entry in instance network info cache for port ff5905b9-ac5a-454f-9259-5a2a368e56e1. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG nova.network.neutron [req-030dbf2c-b871-42d9-803b-3d3dd790257e req-fb7b43f0-f054-4917-b471-56377ede75aa service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Updating instance_info_cache with network_info: [{"id": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "address": "fa:16:3e:82:e1:d4", "network": {"id": "d2c00f25-1657-4d58-afd2-bf48698d2457", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109276971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4157791638140e8b3d82e46a4e86d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5905b9-ac", "ovs_interfaceid": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-030dbf2c-b871-42d9-803b-3d3dd790257e req-fb7b43f0-f054-4917-b471-56377ede75aa service nova] Releasing lock "refresh_cache-56115fdf-0fdd-4cce-9ae0-6046422f0a56" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:33:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:33:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:33:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:33:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:33:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7107MB free_disk=25.130535125732422GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 827d6c12-deb5-4c05-ad6b-efba319783e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e15761ac-028d-40a9-931d-51ef8b77c1cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 61d219ec-0254-41a1-8b53-9177cfe9b585 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 56115fdf-0fdd-4cce-9ae0-6046422f0a56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b26cd058-5116-476d-abc9-ee3d273bbe20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:33:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG nova.objects.instance [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lazy-loading 'flavor' on Instance uuid 56115fdf-0fdd-4cce-9ae0-6046422f0a56 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:13 user nova-compute[72818]: INFO nova.compute.manager [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Attaching volume 83306db2-52ff-457e-ba25-ff8af9ac694f to /dev/vdb
Aug 17 21:33:13 user nova-compute[72818]: DEBUG os_brick.utils [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4cff0a-ad64-4105-9283-d67df467a429]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[153f3a5e-434f-494b-a09b-088df65db437]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c71d37-e8d0-43c3-8698-6b79c5a5f427]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2badbe-7edb-4273-9023-856926863a74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:33:13 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:33:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52be455-6663-485b-8347-1fdc4075b7b4]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG os_brick.utils [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:33:13 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Updating existing volume attachment record: e1358bc8-cb9f-435c-a86b-80cf1cc8b960 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:33:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:17 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:33:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXlnriuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:33:25 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:33:25 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:33:25 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e2b4ee-4003-4136-84e1-ec9cd95a11d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:33:25 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49d3fcd-b053-4e3e-9886-bf793605fc59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f] added
Aug 17 21:33:25 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[292b6d3e-eadf-4795-946a-e3d8e8c768ff]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b447bd21-af94-4e64-b977-3f4e543ea5d4]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXlnriuQ {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXlnriuQ" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ba4a6f-620b-410e-bf89-34358b50ccab]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qXlnriuQ'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2d4f68-10ad-4361-9072-c6fd108b029e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cb47e1-b832-4152-94cd-e1351fb10776]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:25 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:25 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f9e9ca-ee74-4e08-a47e-6a58b4843356]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f, portal: 172.16.0.220,3260]
Aug 17 21:33:25 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f, portal: 172.16.0.220,3260] successful.
Aug 17 21:33:25 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d61531-a8ab-4e32-a6f1-d6949866c907]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7609c846-8457-4c07-b7a6-9b15494a4702]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f (non-flash)
Aug 17 21:33:25 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:25 user nova-compute[72818]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f (non-flash)
Aug 17 21:33:25 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] HCTL ('40', '-', '-', 0) found on session 38 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[804b9451-8e41-456f-ba12-a6cd33385b83]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:25 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Searching for a device in session 38 and hctl ['40', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:33:26 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Searching for a device in session 38 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:33:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXlnriuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:33:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:33:26 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23031376266386534', 'path': '/dev/sdi'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:33:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031376266386534', 'path': '/dev/sdi'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:33:26 user nova-compute[72818]: DEBUG nova.objects.instance [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lazy-loading 'flavor' on Instance uuid 56115fdf-0fdd-4cce-9ae0-6046422f0a56 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:33:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:33:26 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:33:26 user nova-compute[72818]:   <source dev="/dev/sdi"/>
Aug 17 21:33:26 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:33:26 user nova-compute[72818]:   <serial>83306db2-52ff-457e-ba25-ff8af9ac694f</serial>
Aug 17 21:33:26 user nova-compute[72818]: </disk>
Aug 17 21:33:26 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:33:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:33:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:33:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:33:26 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] No VIF found with MAC fa:16:3e:82:e1:d4, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:33:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e0932c9e-a283-4a4f-83b4-8092d9f6def6 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.751s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:28 user nova-compute[72818]: INFO nova.compute.manager [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Detaching volume 83306db2-52ff-457e-ba25-ff8af9ac694f
Aug 17 21:33:28 user nova-compute[72818]: INFO nova.virt.block_device [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Attempting to driver detach volume 83306db2-52ff-457e-ba25-ff8af9ac694f from mountpoint /dev/vdb
Aug 17 21:33:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Attempting to detach device vdb from instance 56115fdf-0fdd-4cce-9ae0-6046422f0a56 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:33:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:33:28 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:33:28 user nova-compute[72818]:   <source dev="/dev/sdi"/>
Aug 17 21:33:28 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:33:28 user nova-compute[72818]:   <serial>83306db2-52ff-457e-ba25-ff8af9ac694f</serial>
Aug 17 21:33:28 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:33:28 user nova-compute[72818]: </disk>
Aug 17 21:33:28 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:33:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Successfully detached device vdb from instance 56115fdf-0fdd-4cce-9ae0-6046422f0a56 from the persistent domain config.
Aug 17 21:33:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 56115fdf-0fdd-4cce-9ae0-6046422f0a56 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:33:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:33:28 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:33:28 user nova-compute[72818]:   <source dev="/dev/sdi"/>
Aug 17 21:33:28 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:33:28 user nova-compute[72818]:   <serial>83306db2-52ff-457e-ba25-ff8af9ac694f</serial>
Aug 17 21:33:28 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:33:28 user nova-compute[72818]: </disk>
Aug 17 21:33:28 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308009.1773968, 56115fdf-0fdd-4cce-9ae0-6046422f0a56 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 56115fdf-0fdd-4cce-9ae0-6046422f0a56 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:33:29 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Successfully detached device vdb from instance 56115fdf-0fdd-4cce-9ae0-6046422f0a56 from the live domain config.
Aug 17 21:33:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXlnriuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:33:29 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ecfb1d-0f9e-4890-be2c-6eb261acf18f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c58c549-6878-4b5b-add0-e52dab06ddb2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f (non-flash)
Aug 17 21:33:29 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:29 user nova-compute[72818]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f (non-flash)
Aug 17 21:33:29 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04dfe290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f'): ({'sdi'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Removing single pathed devices sdi {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[01301b02-e46a-4725-b5d4-af1705d6469f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e7cacb-6be3-4e51-be3e-894b8f6a414e]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Flushing IO for device /dev/sdi {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39a3a69-8882-4404-89b2-88bd15d6bf0c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[141daa0e-e29f-46ed-890f-a94848003b9d]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] SCSI volumes sdi have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82ffe5c-2d6e-4d3f-9f6c-32758f3244f0]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e50a4a-c2c8-4ae7-892a-a62d9b518d76]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f, portal: 172.16.0.220,3260]
Aug 17 21:33:29 user nova-compute[72818]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f, portal: 172.16.0.220,3260] successful.
Aug 17 21:33:29 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83306db2-52ff-457e-ba25-ff8af9ac694f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c83a0e1-7fac-419c-b288-8ee1cbbef5c8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] <== disconnect_volume: return (310ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:33:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:33:30 user nova-compute[72818]: DEBUG nova.objects.instance [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lazy-loading 'flavor' on Instance uuid 56115fdf-0fdd-4cce-9ae0-6046422f0a56 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:33:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c9d5e4d1-0972-4d64-92f2-c491a7afdc39 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.636s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:36 user nova-compute[72818]: INFO nova.compute.manager [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Terminating instance
Aug 17 21:33:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-8e908eba-2fde-4949-9bb9-ca0b1e437e5b req-29d74c6c-889d-4a43-8c0a-a482266f7449 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-unplugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8e908eba-2fde-4949-9bb9-ca0b1e437e5b req-29d74c6c-889d-4a43-8c0a-a482266f7449 service nova] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8e908eba-2fde-4949-9bb9-ca0b1e437e5b req-29d74c6c-889d-4a43-8c0a-a482266f7449 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8e908eba-2fde-4949-9bb9-ca0b1e437e5b req-29d74c6c-889d-4a43-8c0a-a482266f7449 service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-8e908eba-2fde-4949-9bb9-ca0b1e437e5b req-29d74c6c-889d-4a43-8c0a-a482266f7449 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] No waiting events found dispatching network-vif-unplugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-8e908eba-2fde-4949-9bb9-ca0b1e437e5b req-29d74c6c-889d-4a43-8c0a-a482266f7449 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-unplugged-67586c8a-e841-4778-891e-27307f1dbe67 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:37 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Instance destroyed successfully.
Aug 17 21:33:37 user nova-compute[72818]: DEBUG nova.objects.instance [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'resources' on Instance uuid 827d6c12-deb5-4c05-ad6b-efba319783e9 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1276307221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1276307221',id=11,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:19:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-86p4d4ae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:21:35Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=827d6c12-deb5-4c05-ad6b-efba319783e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "67586c8a-e841-4778-891e-27307f1dbe67", "address": "fa:16:3e:5b:d5:dd", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67586c8a-e8", "ovs_interfaceid": "67586c8a-e841-4778-891e-27307f1dbe67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:d5:dd,bridge_name='br-int',has_traffic_filtering=True,id=67586c8a-e841-4778-891e-27307f1dbe67,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67586c8a-e8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_vif [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:d5:dd,bridge_name='br-int',has_traffic_filtering=True,id=67586c8a-e841-4778-891e-27307f1dbe67,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67586c8a-e8') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67586c8a-e8, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:37 user nova-compute[72818]: INFO os_vif [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:d5:dd,bridge_name='br-int',has_traffic_filtering=True,id=67586c8a-e841-4778-891e-27307f1dbe67,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67586c8a-e8')
Aug 17 21:33:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrihzSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:33:37 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7192649-b499-447e-86ab-5212353bea0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc253283-7eeb-41ad-8b0b-1a89dfad5f02]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:33:37 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:33:37 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:37 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:33:37 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:37 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:37 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:37 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a (non-flash)
Aug 17 21:33:37 user nova-compute[72818]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:33:37 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:37 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:33:37 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:37 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:37 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:37 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04e51cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a'): ({'sdh'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Removing single pathed devices sdh {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7fff0d-d1d3-4aa7-bab1-4ffd21d829c1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa973c36-afc5-43ca-8dd0-6ab5bd9a15c1]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Flushing IO for device /dev/sdh {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de7323d-2c5a-4491-b32a-5ccc20fdd799]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f6b487-e0e6-4e7d-8fae-9745558047e9]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] SCSI volumes sdh have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d16000-9627-4f86-a42e-c29152077594]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[462c96dc-5db7-4a92-be48-ad25bb11c053]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a, portal: 172.16.0.220,3260]
Aug 17 21:33:37 user nova-compute[72818]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a, portal: 172.16.0.220,3260] successful.
Aug 17 21:33:37 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9020bf-fade-4fea-a929-3910080fdf9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d159a9f7-ca27-4125-9e7a-e377dd59dab2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] <== disconnect_volume: return (296ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:33:37 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Deleting instance files /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9_del
Aug 17 21:33:37 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Deletion of /opt/stack/data/nova/instances/827d6c12-deb5-4c05-ad6b-efba319783e9_del complete
Aug 17 21:33:37 user nova-compute[72818]: INFO nova.compute.manager [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 17 21:33:37 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:33:37 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:33:38 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:33:38 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Took 0.62 seconds to deallocate network for instance.
Aug 17 21:33:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-f2a2c051-9481-45f9-8e4c-b2dc6239e342 req-1803d1d0-709b-4c51-ad09-0fcc452961e2 service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-deleted-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:33:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-9fcab254-2096-4de0-807b-7b2238df0f7c req-54a1a007-ddca-4d2b-809e-5190d42b61cc service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:33:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9fcab254-2096-4de0-807b-7b2238df0f7c req-54a1a007-ddca-4d2b-809e-5190d42b61cc service nova] Acquiring lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9fcab254-2096-4de0-807b-7b2238df0f7c req-54a1a007-ddca-4d2b-809e-5190d42b61cc service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9fcab254-2096-4de0-807b-7b2238df0f7c req-54a1a007-ddca-4d2b-809e-5190d42b61cc service nova] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-9fcab254-2096-4de0-807b-7b2238df0f7c req-54a1a007-ddca-4d2b-809e-5190d42b61cc service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] No waiting events found dispatching network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:33:38 user nova-compute[72818]: WARNING nova.compute.manager [req-9fcab254-2096-4de0-807b-7b2238df0f7c req-54a1a007-ddca-4d2b-809e-5190d42b61cc service nova] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Received unexpected event network-vif-plugged-67586c8a-e841-4778-891e-27307f1dbe67 for instance with vm_state active and task_state deleting.
Aug 17 21:33:38 user nova-compute[72818]: INFO nova.compute.manager [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Took 0.78 seconds to detach 1 volumes for instance.
Aug 17 21:33:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:39 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:33:39 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:33:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:39 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Deleted allocations for instance 827d6c12-deb5-4c05-ad6b-efba319783e9
Aug 17 21:33:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-122a1fa0-a1cf-44ca-b5b9-e6a32c140ba8 tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "827d6c12-deb5-4c05-ad6b-efba319783e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.071s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:47 user nova-compute[72818]: DEBUG nova.compute.manager [req-84c77acd-5502-4f63-9a88-75648929c8bf req-f6f190a7-566e-4355-bf00-75c7fe88a637 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Received event network-changed-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:33:47 user nova-compute[72818]: DEBUG nova.compute.manager [req-84c77acd-5502-4f63-9a88-75648929c8bf req-f6f190a7-566e-4355-bf00-75c7fe88a637 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Refreshing instance network info cache due to event network-changed-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:33:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-84c77acd-5502-4f63-9a88-75648929c8bf req-f6f190a7-566e-4355-bf00-75c7fe88a637 service nova] Acquiring lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:33:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-84c77acd-5502-4f63-9a88-75648929c8bf req-f6f190a7-566e-4355-bf00-75c7fe88a637 service nova] Acquired lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:33:47 user nova-compute[72818]: DEBUG nova.network.neutron [req-84c77acd-5502-4f63-9a88-75648929c8bf req-f6f190a7-566e-4355-bf00-75c7fe88a637 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Refreshing network info cache for port c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:33:48 user nova-compute[72818]: DEBUG nova.network.neutron [req-84c77acd-5502-4f63-9a88-75648929c8bf req-f6f190a7-566e-4355-bf00-75c7fe88a637 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updated VIF entry in instance network info cache for port c48bf93f-2922-454f-a8ac-f8a92d7b0b6a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:33:48 user nova-compute[72818]: DEBUG nova.network.neutron [req-84c77acd-5502-4f63-9a88-75648929c8bf req-f6f190a7-566e-4355-bf00-75c7fe88a637 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updating instance_info_cache with network_info: [{"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:33:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-84c77acd-5502-4f63-9a88-75648929c8bf req-f6f190a7-566e-4355-bf00-75c7fe88a637 service nova] Releasing lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.compute.manager [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Stashing vm_state: active {{(pid=72818) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'pci_requests' on Instance uuid 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:33:49 user nova-compute[72818]: INFO nova.compute.claims [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Claim successful on node user
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'resources' on Instance uuid 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:33:49 user nova-compute[72818]: INFO nova.compute.resource_tracker [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Updating resource usage from migration 6862d14a-ac1c-4b2c-9c1a-8ddbf8d5ad14
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.compute.manager [req-288badf0-8d07-4bf5-85b6-c4374996ccc8 req-91a8a6c8-e440-407e-a3d9-bdfd2858a020 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-changed-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.compute.manager [req-288badf0-8d07-4bf5-85b6-c4374996ccc8 req-91a8a6c8-e440-407e-a3d9-bdfd2858a020 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Refreshing instance network info cache due to event network-changed-ff979858-3d61-4234-b7fc-f3f738f6e640. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-288badf0-8d07-4bf5-85b6-c4374996ccc8 req-91a8a6c8-e440-407e-a3d9-bdfd2858a020 service nova] Acquiring lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-288badf0-8d07-4bf5-85b6-c4374996ccc8 req-91a8a6c8-e440-407e-a3d9-bdfd2858a020 service nova] Acquired lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.network.neutron [req-288badf0-8d07-4bf5-85b6-c4374996ccc8 req-91a8a6c8-e440-407e-a3d9-bdfd2858a020 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Refreshing network info cache for port ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.compute.manager [req-4045448a-5df6-40dc-9298-7c2068a1063e req-a4a26d6e-e0f3-40de-9777-4d7df4865b30 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Received event network-changed-09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.compute.manager [req-4045448a-5df6-40dc-9298-7c2068a1063e req-a4a26d6e-e0f3-40de-9777-4d7df4865b30 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Refreshing instance network info cache due to event network-changed-09fec2e3-cf08-428f-991d-a1d4abad7ca6. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4045448a-5df6-40dc-9298-7c2068a1063e req-a4a26d6e-e0f3-40de-9777-4d7df4865b30 service nova] Acquiring lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4045448a-5df6-40dc-9298-7c2068a1063e req-a4a26d6e-e0f3-40de-9777-4d7df4865b30 service nova] Acquired lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.network.neutron [req-4045448a-5df6-40dc-9298-7c2068a1063e req-a4a26d6e-e0f3-40de-9777-4d7df4865b30 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Refreshing network info cache for port 09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:33:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.490s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:49 user nova-compute[72818]: INFO nova.compute.manager [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Migrating
Aug 17 21:33:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:50 user nova-compute[72818]: INFO nova.compute.manager [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Detaching volume 8fc8ad73-7ddc-4889-9721-2246440ad0f3
Aug 17 21:33:50 user nova-compute[72818]: DEBUG nova.network.neutron [req-288badf0-8d07-4bf5-85b6-c4374996ccc8 req-91a8a6c8-e440-407e-a3d9-bdfd2858a020 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updated VIF entry in instance network info cache for port ff979858-3d61-4234-b7fc-f3f738f6e640. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG nova.network.neutron [req-288badf0-8d07-4bf5-85b6-c4374996ccc8 req-91a8a6c8-e440-407e-a3d9-bdfd2858a020 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updating instance_info_cache with network_info: [{"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-288badf0-8d07-4bf5-85b6-c4374996ccc8 req-91a8a6c8-e440-407e-a3d9-bdfd2858a020 service nova] Releasing lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:33:50 user nova-compute[72818]: INFO nova.virt.block_device [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Attempting to driver detach volume 8fc8ad73-7ddc-4889-9721-2246440ad0f3 from mountpoint /dev/vdb
Aug 17 21:33:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Attempting to detach device vdb from instance e15761ac-028d-40a9-931d-51ef8b77c1cf from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:33:50 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:33:50 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:33:50 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:33:50 user nova-compute[72818]:   <serial>8fc8ad73-7ddc-4889-9721-2246440ad0f3</serial>
Aug 17 21:33:50 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:33:50 user nova-compute[72818]: </disk>
Aug 17 21:33:50 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:33:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Successfully detached device vdb from instance e15761ac-028d-40a9-931d-51ef8b77c1cf from the persistent domain config.
Aug 17 21:33:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e15761ac-028d-40a9-931d-51ef8b77c1cf from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:33:50 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:33:50 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:33:50 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:33:50 user nova-compute[72818]:   <serial>8fc8ad73-7ddc-4889-9721-2246440ad0f3</serial>
Aug 17 21:33:50 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:33:50 user nova-compute[72818]: </disk>
Aug 17 21:33:50 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG nova.network.neutron [req-4045448a-5df6-40dc-9298-7c2068a1063e req-a4a26d6e-e0f3-40de-9777-4d7df4865b30 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Updated VIF entry in instance network info cache for port 09fec2e3-cf08-428f-991d-a1d4abad7ca6. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG nova.network.neutron [req-4045448a-5df6-40dc-9298-7c2068a1063e req-a4a26d6e-e0f3-40de-9777-4d7df4865b30 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Updating instance_info_cache with network_info: [{"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4045448a-5df6-40dc-9298-7c2068a1063e req-a4a26d6e-e0f3-40de-9777-4d7df4865b30 service nova] Releasing lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquired lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG nova.network.neutron [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308030.6989026, e15761ac-028d-40a9-931d-51ef8b77c1cf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:33:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Successfully detached device vdb from instance e15761ac-028d-40a9-931d-51ef8b77c1cf from the live domain config.
Aug 17 21:33:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hyDanOWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:33:50 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[89212678-69ca-4270-aa07-6627ab60178d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b334e2a0-b65b-4796-8a25-f3e93029dcfa]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:33:50 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:50 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:33:50 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:50 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:50 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:50 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 (non-flash)
Aug 17 21:33:50 user nova-compute[72818]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:50 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:33:50 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:50 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:50 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:50 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04c24550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66a6b08-b5d3-428a-a31c-89e2ec6dafca]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ef2d43-9a4f-47da-905e-e89b80965727]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f00811-5691-4378-b359-0310866a999e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e9795e-1a11-4497-b1c1-8eb0deea03a9]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e90f5d5-3870-44d7-b278-b98f9bf228e0]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[34518cb2-5f23-4796-82b6-cc7564996f30]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3, portal: 172.16.0.220,3260]
Aug 17 21:33:50 user nova-compute[72818]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3, portal: 172.16.0.220,3260] successful.
Aug 17 21:33:50 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc8ad73-7ddc-4889-9721-2246440ad0f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b363d1da-21ff-447b-b3b1-8267be1fdd89]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] <== disconnect_volume: return (308ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.network.neutron [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Updating instance_info_cache with network_info: [{"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Releasing lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Starting migrate_disk_and_power_off {{(pid=72818) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-79600655-5ae6-4188-b6e0-3b6434287cd9 req-549e012c-7348-4408-825e-60e3fe158acf service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-changed-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-79600655-5ae6-4188-b6e0-3b6434287cd9 req-549e012c-7348-4408-825e-60e3fe158acf service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Refreshing instance network info cache due to event network-changed-ff979858-3d61-4234-b7fc-f3f738f6e640. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-79600655-5ae6-4188-b6e0-3b6434287cd9 req-549e012c-7348-4408-825e-60e3fe158acf service nova] Acquiring lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-79600655-5ae6-4188-b6e0-3b6434287cd9 req-549e012c-7348-4408-825e-60e3fe158acf service nova] Acquired lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.network.neutron [req-79600655-5ae6-4188-b6e0-3b6434287cd9 req-549e012c-7348-4408-825e-60e3fe158acf service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Refreshing network info cache for port ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.objects.instance [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'flavor' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-0a6a619b-4c39-43bf-a8d4-f64b82f9ead0 req-cde26e86-e076-4675-ac9b-2b82ee93c9a4 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Received event network-vif-unplugged-09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0a6a619b-4c39-43bf-a8d4-f64b82f9ead0 req-cde26e86-e076-4675-ac9b-2b82ee93c9a4 service nova] Acquiring lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0a6a619b-4c39-43bf-a8d4-f64b82f9ead0 req-cde26e86-e076-4675-ac9b-2b82ee93c9a4 service nova] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0a6a619b-4c39-43bf-a8d4-f64b82f9ead0 req-cde26e86-e076-4675-ac9b-2b82ee93c9a4 service nova] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-0a6a619b-4c39-43bf-a8d4-f64b82f9ead0 req-cde26e86-e076-4675-ac9b-2b82ee93c9a4 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] No waiting events found dispatching network-vif-unplugged-09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:33:51 user nova-compute[72818]: WARNING nova.compute.manager [req-0a6a619b-4c39-43bf-a8d4-f64b82f9ead0 req-cde26e86-e076-4675-ac9b-2b82ee93c9a4 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Received unexpected event network-vif-unplugged-09fec2e3-cf08-428f-991d-a1d4abad7ca6 for instance with vm_state active and task_state resize_migrating.
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-0a6a619b-4c39-43bf-a8d4-f64b82f9ead0 req-cde26e86-e076-4675-ac9b-2b82ee93c9a4 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Received event network-vif-plugged-09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0a6a619b-4c39-43bf-a8d4-f64b82f9ead0 req-cde26e86-e076-4675-ac9b-2b82ee93c9a4 service nova] Acquiring lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0a6a619b-4c39-43bf-a8d4-f64b82f9ead0 req-cde26e86-e076-4675-ac9b-2b82ee93c9a4 service nova] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0a6a619b-4c39-43bf-a8d4-f64b82f9ead0 req-cde26e86-e076-4675-ac9b-2b82ee93c9a4 service nova] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.compute.manager [req-0a6a619b-4c39-43bf-a8d4-f64b82f9ead0 req-cde26e86-e076-4675-ac9b-2b82ee93c9a4 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] No waiting events found dispatching network-vif-plugged-09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:33:51 user nova-compute[72818]: WARNING nova.compute.manager [req-0a6a619b-4c39-43bf-a8d4-f64b82f9ead0 req-cde26e86-e076-4675-ac9b-2b82ee93c9a4 service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Received unexpected event network-vif-plugged-09fec2e3-cf08-428f-991d-a1d4abad7ca6 for instance with vm_state active and task_state resize_migrating.
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4336b582-b884-406b-bfba-78678738bc93 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:51 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Instance destroyed successfully.
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:31:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1592742420',display_name='tempest-ServerActionsTestOtherA-server-1592742420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1592742420',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV/yxdZf0gbz0Oc0hEv4WwXP2jV20fy0LitgWYnfEN52KHQjmeuLO48ZiCuSailjRm1wHuszXDlB837Vche8MvGzjfdhLQW/IYo033/9mpCOWKkYkF4Ly8lZgNbXJbUlw==',key_name='tempest-keypair-570023473',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-9abyhwyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:33:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=2e4ea99b-4bfd-4c21-9824-ffa3ad63164a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1787003302-network", "vif_mac": "fa:16:3e:53:89:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1787003302-network", "vif_mac": "fa:16:3e:53:89:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:89:2d,bridge_name='br-int',has_traffic_filtering=True,id=09fec2e3-cf08-428f-991d-a1d4abad7ca6,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fec2e3-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG os_vif [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:89:2d,bridge_name='br-int',has_traffic_filtering=True,id=09fec2e3-cf08-428f-991d-a1d4abad7ca6,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fec2e3-cf') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09fec2e3-cf, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:33:51 user nova-compute[72818]: INFO os_vif [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:89:2d,bridge_name='br-int',has_traffic_filtering=True,id=09fec2e3-cf08-428f-991d-a1d4abad7ca6,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fec2e3-cf')
Aug 17 21:33:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZCsrAIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:33:51 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:33:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09d0e55-c00d-417c-a754-98281bab0697]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[44262e0b-174e-4e8b-a32d-0443e72e676e]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:52 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:33:52 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:52 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:52 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:52 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:52 user nova-compute[72818]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 (non-flash)
Aug 17 21:33:52 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:52 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:52 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:52 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04e527a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43'): ({'sdc'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Removing single pathed devices sdc {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308017.0234237, 827d6c12-deb5-4c05-ad6b-efba319783e9 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:33:52 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] VM Stopped (Lifecycle Event)
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f87f72-1c24-453d-b0f5-72b219e7656c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG nova.compute.manager [None req-69b802ec-adc3-4eff-9820-e37cd019d346 None None] [instance: 827d6c12-deb5-4c05-ad6b-efba319783e9] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ceeef8-7841-4503-ac8c-aa7e886c950f]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Flushing IO for device /dev/sdc {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3e3153-5d50-4595-ae03-2652b04db0ca]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4e2a22-aa59-4cab-b78a-c0d22ed80cc3]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23263336131646666', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_59e89bb2', '/dev/disk/by-id/scsi-1SCST_BIO59e89bb2-2c3a1dffb1579af4') {{(pid=83620) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 21:33:52 user nova-compute[72818]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23263336131646666
Aug 17 21:33:52 user nova-compute[72818]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO59e89bb2-2c3a1dffb1579af4
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f4ecaf-3672-45af-abad-05929d697927]: (4, None) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c92ca8a-f65a-4ca7-8ace-9d00fa7727e5]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0057ad15-5629-4472-886a-31bb87c55c20]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43, portal: 172.16.0.220,3260]
Aug 17 21:33:52 user nova-compute[72818]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43, portal: 172.16.0.220,3260] successful.
Aug 17 21:33:52 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG nova.network.neutron [req-79600655-5ae6-4188-b6e0-3b6434287cd9 req-549e012c-7348-4408-825e-60e3fe158acf service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updated VIF entry in instance network info cache for port ff979858-3d61-4234-b7fc-f3f738f6e640. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG nova.network.neutron [req-79600655-5ae6-4188-b6e0-3b6434287cd9 req-549e012c-7348-4408-825e-60e3fe158acf service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updating instance_info_cache with network_info: [{"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-79600655-5ae6-4188-b6e0-3b6434287cd9 req-549e012c-7348-4408-825e-60e3fe158acf service nova] Releasing lock "refresh_cache-e15761ac-028d-40a9-931d-51ef8b77c1cf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf92d289-6524-4164-a7e0-376368d01665]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] <== disconnect_volume: return (317ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:33:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG nova.network.neutron [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Port 09fec2e3-cf08-428f-991d-a1d4abad7ca6 binding to destination host user is already ACTIVE {{(pid=72818) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquired lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG nova.network.neutron [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG nova.network.neutron [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Updating instance_info_cache with network_info: [{"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Releasing lock "refresh_cache-2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG os_brick.utils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8676cf32-e510-4547-9604-5fdd36496240]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0fe723-8f7d-4ddb-a69c-44bd451c3546]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cea1c90-e262-456e-b0a0-a383a2da4627]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d704b274-967f-4426-9dcb-b22a69da18e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:33:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:33:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:33:54 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:33:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d617ca6a-9b0f-4036-9bff-e586d435d52a]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:33:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:33:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:33:54 user nova-compute[72818]: DEBUG os_brick.utils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:33:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:33:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:33:59 user nova-compute[72818]: INFO nova.compute.manager [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Detaching volume 28aedce7-4232-412f-ba04-bd66b329c60a
Aug 17 21:33:59 user nova-compute[72818]: INFO nova.virt.block_device [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Attempting to driver detach volume 28aedce7-4232-412f-ba04-bd66b329c60a from mountpoint /dev/vdb
Aug 17 21:33:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Attempting to detach device vdb from instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:33:59 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:33:59 user nova-compute[72818]:   <source dev="/dev/sdd"/>
Aug 17 21:33:59 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:33:59 user nova-compute[72818]:   <serial>28aedce7-4232-412f-ba04-bd66b329c60a</serial>
Aug 17 21:33:59 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 21:33:59 user nova-compute[72818]: </disk>
Aug 17 21:33:59 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:33:59 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully detached device vdb from instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f from the persistent domain config.
Aug 17 21:33:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:33:59 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:33:59 user nova-compute[72818]:   <source dev="/dev/sdd"/>
Aug 17 21:33:59 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:33:59 user nova-compute[72818]:   <serial>28aedce7-4232-412f-ba04-bd66b329c60a</serial>
Aug 17 21:33:59 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 21:33:59 user nova-compute[72818]: </disk>
Aug 17 21:33:59 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308039.6877162, e322a0ce-e887-4e29-a5c4-a0da74db3c7f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:33:59 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully detached device vdb from instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f from the live domain config.
Aug 17 21:33:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUwgBsdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:33:59 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e9066b-351f-4561-bb52-98cb2f6cd11e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a13a15-d5d4-4799-b559-b77b6b268718]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:59 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:59 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:59 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:33:59 user nova-compute[72818]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a (non-flash)
Aug 17 21:33:59 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:33:59 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:33:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f2853bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a'): ({'sdd'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Removing single pathed devices sdd {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7267cd3-3efb-4662-89e9-07d9324e7137]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7c81bb-89c6-4df8-ad06-821af35711e7]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Flushing IO for device /dev/sdd {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e698f250-5b08-4136-8bdc-4358a2ba84ac]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[239218b4-0800-4087-965f-38682feb1570]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c13110-9c42-4042-90d4-2282baf6aa88]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f14c8a5-c0e2-4c6f-9c1c-031547bd3746]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260]
Aug 17 21:33:59 user nova-compute[72818]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a, portal: 172.16.0.220,3260] successful.
Aug 17 21:33:59 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e2b2ac-a178-4a57-852f-47be624209a7]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] <== disconnect_volume: return (289ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:33:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:34:00 user nova-compute[72818]: DEBUG nova.objects.instance [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:34:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9cb77207-ac80-4a5e-9bc4-c158c6831dbe tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.661s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.volume.cinder [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Update attachment failed for attachment 4bb35541-e362-4081-aecd-e79d4a1528d3. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a was not found.).). (HTTP 500) (Request-ID: req-607ac250-a807-483a-9ef2-3c20e301a589) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a was not found.).). (HTTP 500) (Request-ID: req-607ac250-a807-483a-9ef2-3c20e301a589)
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a was not found.).). (HTTP 500) (Request-ID: req-607ac250-a807-483a-9ef2-3c20e301a589)
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Traceback (most recent call last):
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/nova/nova/compute/manager.py", line 10766, in _error_out_instance_on_exception
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     yield
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/nova/nova/compute/manager.py", line 6298, in _finish_resize_helper
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     network_info = self._finish_resize(context, instance, migration,
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/nova/nova/compute/manager.py", line 6202, in _finish_resize
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     self._update_volume_attachments(context, instance, bdms)
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/nova/nova/compute/manager.py", line 6132, in _update_volume_attachments
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     self.volume_api.attachment_update(
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     res = method(self, ctx, *args, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     with excutils.save_and_reraise_exception():
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     self.force_reraise()
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     raise self.value
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     return method.func(obj, *args, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     resp = self._update('/attachments/%s' % id, body)
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     return self.request(url, method, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a]     raise exceptions.from_response(resp, body)
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a was not found.).). (HTTP 500) (Request-ID: req-607ac250-a807-483a-9ef2-3c20e301a589)
Aug 17 21:34:01 user nova-compute[72818]: ERROR nova.compute.manager [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] 
Aug 17 21:34:01 user nova-compute[72818]: INFO nova.compute.manager [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Deleting allocations for old flavor on source node user after finish_resize failure. You may be able to recover the instance by hard rebooting it.
Aug 17 21:34:01 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Deleted allocation for migration 6862d14a-ac1c-4b2c-9c1a-8ddbf8d5ad14
Aug 17 21:34:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6048aba1-f461-4ad9-bbc2-7c0ac1788737 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6048aba1-f461-4ad9-bbc2-7c0ac1788737 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG nova.compute.manager [None req-6048aba1-f461-4ad9-bbc2-7c0ac1788737 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG nova.compute.manager [None req-6048aba1-f461-4ad9-bbc2-7c0ac1788737 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72818) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG nova.objects.instance [None req-6048aba1-f461-4ad9-bbc2-7c0ac1788737 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-bd9e3301-2a43-499c-afb9-9a775fa5331f req-1411495c-bdb8-4d9a-9c43-35b547cb796a service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-unplugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bd9e3301-2a43-499c-afb9-9a775fa5331f req-1411495c-bdb8-4d9a-9c43-35b547cb796a service nova] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bd9e3301-2a43-499c-afb9-9a775fa5331f req-1411495c-bdb8-4d9a-9c43-35b547cb796a service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bd9e3301-2a43-499c-afb9-9a775fa5331f req-1411495c-bdb8-4d9a-9c43-35b547cb796a service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-bd9e3301-2a43-499c-afb9-9a775fa5331f req-1411495c-bdb8-4d9a-9c43-35b547cb796a service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] No waiting events found dispatching network-vif-unplugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:01 user nova-compute[72818]: WARNING nova.compute.manager [req-bd9e3301-2a43-499c-afb9-9a775fa5331f req-1411495c-bdb8-4d9a-9c43-35b547cb796a service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received unexpected event network-vif-unplugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d for instance with vm_state active and task_state powering-off.
Aug 17 21:34:01 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:01 user nova-compute[72818]: INFO nova.compute.manager [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Successfully reverted task state from resize_finish on failure for instance.
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server [None req-7d454345-878d-4181-8457-d429c51feff5 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a was not found.).). (HTTP 500) (Request-ID: req-607ac250-a807-483a-9ef2-3c20e301a589)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6268, in finish_resize
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6265, in finish_resize
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self._finish_resize_helper(context, disk_info, image, instance,
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6298, in _finish_resize_helper
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     network_info = self._finish_resize(context, instance, migration,
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6202, in _finish_resize
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6132, in _update_volume_attachments
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:28aedce7-4232-412f-ba04-bd66b329c60a was not found.).). (HTTP 500) (Request-ID: req-607ac250-a807-483a-9ef2-3c20e301a589)
Aug 17 21:34:01 user nova-compute[72818]: ERROR oslo_messaging.rpc.server 
Aug 17 21:34:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance destroyed successfully.
Aug 17 21:34:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-6048aba1-f461-4ad9-bbc2-7c0ac1788737 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:34:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6048aba1-f461-4ad9-bbc2-7c0ac1788737 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.829s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-2c1b3d02-8396-43d8-a8fb-082cf728e2e6 req-b73bbcef-afd9-4bc1-9ab3-7ea1145b143d service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2c1b3d02-8396-43d8-a8fb-082cf728e2e6 req-b73bbcef-afd9-4bc1-9ab3-7ea1145b143d service nova] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2c1b3d02-8396-43d8-a8fb-082cf728e2e6 req-b73bbcef-afd9-4bc1-9ab3-7ea1145b143d service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2c1b3d02-8396-43d8-a8fb-082cf728e2e6 req-b73bbcef-afd9-4bc1-9ab3-7ea1145b143d service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-2c1b3d02-8396-43d8-a8fb-082cf728e2e6 req-b73bbcef-afd9-4bc1-9ab3-7ea1145b143d service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] No waiting events found dispatching network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:03 user nova-compute[72818]: WARNING nova.compute.manager [req-2c1b3d02-8396-43d8-a8fb-082cf728e2e6 req-b73bbcef-afd9-4bc1-9ab3-7ea1145b143d service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received unexpected event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d for instance with vm_state stopped and task_state None.
Aug 17 21:34:03 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:34:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:34:05 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:34:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:34:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:34:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:34:05 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:34:06 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updating instance_info_cache with network_info: [{"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:34:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:34:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:34:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:34:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:34:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:34:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:34:06 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308031.909124, 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:34:06 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] VM Stopped (Lifecycle Event)
Aug 17 21:34:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-67fb4664-d12c-46dc-b54d-657daf7ea3b7 None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:34:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-67fb4664-d12c-46dc-b54d-657daf7ea3b7 None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: error, current task_state: None, current DB power_state: 1, VM power_state: 4 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:34:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:06 user nova-compute[72818]: INFO nova.compute.manager [None req-67fb4664-d12c-46dc-b54d-657daf7ea3b7 None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (4). Updating power_state in the DB to match the hypervisor.
Aug 17 21:34:07 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:34:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:07 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:34:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:34:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:34:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:34:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:34:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7542MB free_disk=25.11241912841797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Applying migration context for instance 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a as it has an incoming, in-progress migration 6862d14a-ac1c-4b2c-9c1a-8ddbf8d5ad14. Migration status is error {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=72818) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b9a0da7f-47b4-467f-944d-49adac671a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e15761ac-028d-40a9-931d-51ef8b77c1cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 61d219ec-0254-41a1-8b53-9177cfe9b585 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 56115fdf-0fdd-4cce-9ae0-6046422f0a56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance b26cd058-5116-476d-abc9-ee3d273bbe20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-c064133c-a8d8-4b9a-83da-790001a593d6 req-ca7b73e0-730f-4fac-a08f-9442d9f9b262 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Received event network-changed-c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-c064133c-a8d8-4b9a-83da-790001a593d6 req-ca7b73e0-730f-4fac-a08f-9442d9f9b262 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Refreshing instance network info cache due to event network-changed-c02459ee-e640-4825-a874-4c4eaa98684a. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c064133c-a8d8-4b9a-83da-790001a593d6 req-ca7b73e0-730f-4fac-a08f-9442d9f9b262 service nova] Acquiring lock "refresh_cache-b26cd058-5116-476d-abc9-ee3d273bbe20" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c064133c-a8d8-4b9a-83da-790001a593d6 req-ca7b73e0-730f-4fac-a08f-9442d9f9b262 service nova] Acquired lock "refresh_cache-b26cd058-5116-476d-abc9-ee3d273bbe20" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.network.neutron [req-c064133c-a8d8-4b9a-83da-790001a593d6 req-ca7b73e0-730f-4fac-a08f-9442d9f9b262 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Refreshing network info cache for port c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.network.neutron [req-c064133c-a8d8-4b9a-83da-790001a593d6 req-ca7b73e0-730f-4fac-a08f-9442d9f9b262 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Updated VIF entry in instance network info cache for port c02459ee-e640-4825-a874-4c4eaa98684a. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG nova.network.neutron [req-c064133c-a8d8-4b9a-83da-790001a593d6 req-ca7b73e0-730f-4fac-a08f-9442d9f9b262 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Updating instance_info_cache with network_info: [{"id": "c02459ee-e640-4825-a874-4c4eaa98684a", "address": "fa:16:3e:6d:02:4e", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02459ee-e6", "ovs_interfaceid": "c02459ee-e640-4825-a874-4c4eaa98684a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c064133c-a8d8-4b9a-83da-790001a593d6 req-ca7b73e0-730f-4fac-a08f-9442d9f9b262 service nova] Releasing lock "refresh_cache-b26cd058-5116-476d-abc9-ee3d273bbe20" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "b26cd058-5116-476d-abc9-ee3d273bbe20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:12 user nova-compute[72818]: INFO nova.compute.manager [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Terminating instance
Aug 17 21:34:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-d884d61b-70cb-4e90-9d6f-e75b13868e40 req-453eaf22-5706-4753-a437-b86722425268 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Received event network-vif-unplugged-c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d884d61b-70cb-4e90-9d6f-e75b13868e40 req-453eaf22-5706-4753-a437-b86722425268 service nova] Acquiring lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d884d61b-70cb-4e90-9d6f-e75b13868e40 req-453eaf22-5706-4753-a437-b86722425268 service nova] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d884d61b-70cb-4e90-9d6f-e75b13868e40 req-453eaf22-5706-4753-a437-b86722425268 service nova] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-d884d61b-70cb-4e90-9d6f-e75b13868e40 req-453eaf22-5706-4753-a437-b86722425268 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] No waiting events found dispatching network-vif-unplugged-c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-d884d61b-70cb-4e90-9d6f-e75b13868e40 req-453eaf22-5706-4753-a437-b86722425268 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Received event network-vif-unplugged-c02459ee-e640-4825-a874-4c4eaa98684a for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:34:13 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Instance destroyed successfully.
Aug 17 21:34:13 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lazy-loading 'resources' on Instance uuid b26cd058-5116-476d-abc9-ee3d273bbe20 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-16053808',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-16053808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-16053808',id=34,image_ref='cc844951-044e-428e-824a-ed248934c5e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpWPhhXKx27u1pBMgcijThxcrpYnzAwhp7gmBunj6AuwfquKr/cmGhROfmyzA/rIOun4oc5ZWLTUDU4nuxQhgP0j2u0+lxWWaG9Py7DiMx0BCcElRxVB/5KLN1DotHhnA==',key_name='tempest-keypair-1882177992',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:32:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-0a7k203n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-973058317',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:32:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=b26cd058-5116-476d-abc9-ee3d273bbe20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c02459ee-e640-4825-a874-4c4eaa98684a", "address": "fa:16:3e:6d:02:4e", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02459ee-e6", "ovs_interfaceid": "c02459ee-e640-4825-a874-4c4eaa98684a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "c02459ee-e640-4825-a874-4c4eaa98684a", "address": "fa:16:3e:6d:02:4e", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02459ee-e6", "ovs_interfaceid": "c02459ee-e640-4825-a874-4c4eaa98684a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:02:4e,bridge_name='br-int',has_traffic_filtering=True,id=c02459ee-e640-4825-a874-4c4eaa98684a,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02459ee-e6') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_vif [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:02:4e,bridge_name='br-int',has_traffic_filtering=True,id=c02459ee-e640-4825-a874-4c4eaa98684a,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02459ee-e6') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc02459ee-e6, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:13 user nova-compute[72818]: INFO os_vif [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:02:4e,bridge_name='br-int',has_traffic_filtering=True,id=c02459ee-e640-4825-a874-4c4eaa98684a,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02459ee-e6')
Aug 17 21:34:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDuohMRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:34:13 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf07425-32c9-4eca-bfea-0cc4d52ccc3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f53a6f2-e78e-4757-b59e-30b8ea4229c2]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:34:13 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:34:13 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:34:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:34:13 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:34:13 user nova-compute[72818]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b (non-flash)
Aug 17 21:34:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04c05990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b'): ({'sdg'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Removing single pathed devices sdg {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cdd4b3-baca-48c2-a5cb-144f81a358a3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[711ea271-0b89-4bf6-896d-2f9c1c234dfd]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flushing IO for device /dev/sdg {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6946351-5759-4e3e-ad16-815d79558f62]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dfdbc5-ddff-4688-a618-82a3323b6849]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] SCSI volumes sdg have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23831653632626438', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e92bac9a', '/dev/disk/by-id/scsi-1SCST_BIOe92bac9a-81e62bd8559e374b') {{(pid=83620) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 21:34:13 user nova-compute[72818]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23831653632626438
Aug 17 21:34:13 user nova-compute[72818]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_e92bac9a
Aug 17 21:34:13 user nova-compute[72818]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe92bac9a-81e62bd8559e374b
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6248c-ea79-4698-a747-efcde26fe754]: (4, None) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:34:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d460d7a4-7d55-485b-9e67-792b6942dc64]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9a6780-5515-430a-a234-8f997707c75f]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b, portal: 172.16.0.220,3260]
Aug 17 21:34:14 user nova-compute[72818]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b, portal: 172.16.0.220,3260] successful.
Aug 17 21:34:14 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a63abf-7b15-43a4-acca-5a969dda603b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71808ee-f12b-430a-a7e8-7a2d17335092]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== disconnect_volume: return (302ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:34:14 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Deleting instance files /opt/stack/data/nova/instances/b26cd058-5116-476d-abc9-ee3d273bbe20_del
Aug 17 21:34:14 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Deletion of /opt/stack/data/nova/instances/b26cd058-5116-476d-abc9-ee3d273bbe20_del complete
Aug 17 21:34:14 user nova-compute[72818]: INFO nova.compute.manager [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 17 21:34:14 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:34:14 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Took 0.79 seconds to deallocate network for instance.
Aug 17 21:34:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-fcaa2906-e14e-4b82-ac38-feadda839b6d req-32782f5c-123e-4947-a57a-f3b255176e71 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Received event network-vif-deleted-c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:14 user nova-compute[72818]: INFO nova.compute.manager [req-fcaa2906-e14e-4b82-ac38-feadda839b6d req-32782f5c-123e-4947-a57a-f3b255176e71 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Neutron deleted interface c02459ee-e640-4825-a874-4c4eaa98684a; detaching it from the instance and deleting it from the info cache
Aug 17 21:34:14 user nova-compute[72818]: DEBUG nova.network.neutron [req-fcaa2906-e14e-4b82-ac38-feadda839b6d req-32782f5c-123e-4947-a57a-f3b255176e71 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:34:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-fcaa2906-e14e-4b82-ac38-feadda839b6d req-32782f5c-123e-4947-a57a-f3b255176e71 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Detach interface failed, port_id=c02459ee-e640-4825-a874-4c4eaa98684a, reason: Instance b26cd058-5116-476d-abc9-ee3d273bbe20 could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:34:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-248aa3fb-89b1-47ad-8fa8-281ef58a5ab6 req-10e547e8-235d-4a5a-8a82-b9ce4abd66e5 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Received event network-vif-plugged-c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-248aa3fb-89b1-47ad-8fa8-281ef58a5ab6 req-10e547e8-235d-4a5a-8a82-b9ce4abd66e5 service nova] Acquiring lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-248aa3fb-89b1-47ad-8fa8-281ef58a5ab6 req-10e547e8-235d-4a5a-8a82-b9ce4abd66e5 service nova] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-248aa3fb-89b1-47ad-8fa8-281ef58a5ab6 req-10e547e8-235d-4a5a-8a82-b9ce4abd66e5 service nova] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-248aa3fb-89b1-47ad-8fa8-281ef58a5ab6 req-10e547e8-235d-4a5a-8a82-b9ce4abd66e5 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] No waiting events found dispatching network-vif-plugged-c02459ee-e640-4825-a874-4c4eaa98684a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:15 user nova-compute[72818]: WARNING nova.compute.manager [req-248aa3fb-89b1-47ad-8fa8-281ef58a5ab6 req-10e547e8-235d-4a5a-8a82-b9ce4abd66e5 service nova] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Received unexpected event network-vif-plugged-c02459ee-e640-4825-a874-4c4eaa98684a for instance with vm_state active and task_state deleting.
Aug 17 21:34:15 user nova-compute[72818]: INFO nova.compute.manager [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Took 0.76 seconds to detach 1 volumes for instance.
Aug 17 21:34:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Deleting volume: b6a63abf-7b15-43a4-acca-5a969dda603b {{(pid=72818) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 21:34:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:16 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:34:16 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:34:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:16 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Deleted allocations for instance b26cd058-5116-476d-abc9-ee3d273bbe20
Aug 17 21:34:16 user nova-compute[72818]: INFO nova.compute.manager [None req-8cb0960a-7e91-4f64-941c-b56594bce2b8 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Unrescuing
Aug 17 21:34:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8cb0960a-7e91-4f64-941c-b56594bce2b8 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:34:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8cb0960a-7e91-4f64-941c-b56594bce2b8 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquired lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:34:16 user nova-compute[72818]: DEBUG nova.network.neutron [None req-8cb0960a-7e91-4f64-941c-b56594bce2b8 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:34:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8787456f-3a24-468c-856d-683142a6eddf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "b26cd058-5116-476d-abc9-ee3d273bbe20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.431s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308042.1855319, e322a0ce-e887-4e29-a5c4-a0da74db3c7f => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:34:17 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] VM Stopped (Lifecycle Event)
Aug 17 21:34:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-8cb0960a-7e91-4f64-941c-b56594bce2b8 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updating instance_info_cache with network_info: [{"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8f2e4790-9c36-43a7-a70e-5cfec792fecb None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8f2e4790-9c36-43a7-a70e-5cfec792fecb None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8cb0960a-7e91-4f64-941c-b56594bce2b8 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Releasing lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8cb0960a-7e91-4f64-941c-b56594bce2b8 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'flavor' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-cfbb135f-efba-47b7-a130-d19654493230 req-8d329672-5201-4319-8425-de3b8d98377b service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-unplugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cfbb135f-efba-47b7-a130-d19654493230 req-8d329672-5201-4319-8425-de3b8d98377b service nova] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cfbb135f-efba-47b7-a130-d19654493230 req-8d329672-5201-4319-8425-de3b8d98377b service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cfbb135f-efba-47b7-a130-d19654493230 req-8d329672-5201-4319-8425-de3b8d98377b service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-cfbb135f-efba-47b7-a130-d19654493230 req-8d329672-5201-4319-8425-de3b8d98377b service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] No waiting events found dispatching network-vif-unplugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:17 user nova-compute[72818]: WARNING nova.compute.manager [req-cfbb135f-efba-47b7-a130-d19654493230 req-8d329672-5201-4319-8425-de3b8d98377b service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received unexpected event network-vif-unplugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:34:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:18 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Instance destroyed successfully.
Aug 17 21:34:18 user nova-compute[72818]: DEBUG nova.compute.manager [req-6c868f7f-4577-4c7a-82c4-87491ae44e34 req-3a7102ae-7878-4c3c-882c-1d384c835e72 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-changed-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:18 user nova-compute[72818]: DEBUG nova.compute.manager [req-6c868f7f-4577-4c7a-82c4-87491ae44e34 req-3a7102ae-7878-4c3c-882c-1d384c835e72 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Refreshing instance network info cache due to event network-changed-758c519d-4502-4a83-9900-5cdfbc22c4f3. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:34:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c868f7f-4577-4c7a-82c4-87491ae44e34 req-3a7102ae-7878-4c3c-882c-1d384c835e72 service nova] Acquiring lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:34:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c868f7f-4577-4c7a-82c4-87491ae44e34 req-3a7102ae-7878-4c3c-882c-1d384c835e72 service nova] Acquired lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:34:18 user nova-compute[72818]: DEBUG nova.network.neutron [req-6c868f7f-4577-4c7a-82c4-87491ae44e34 req-3a7102ae-7878-4c3c-882c-1d384c835e72 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Refreshing network info cache for port 758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:34:18 user nova-compute[72818]: DEBUG nova.network.neutron [req-6c868f7f-4577-4c7a-82c4-87491ae44e34 req-3a7102ae-7878-4c3c-882c-1d384c835e72 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updated VIF entry in instance network info cache for port 758c519d-4502-4a83-9900-5cdfbc22c4f3. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:34:18 user nova-compute[72818]: DEBUG nova.network.neutron [req-6c868f7f-4577-4c7a-82c4-87491ae44e34 req-3a7102ae-7878-4c3c-882c-1d384c835e72 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updating instance_info_cache with network_info: [{"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:34:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c868f7f-4577-4c7a-82c4-87491ae44e34 req-3a7102ae-7878-4c3c-882c-1d384c835e72 service nova] Releasing lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:34:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-5ba49a67-0901-4218-9e7d-fce79516e348 req-8ee04563-ef6c-4b3c-a1fe-19c49e0ef76d service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5ba49a67-0901-4218-9e7d-fce79516e348 req-8ee04563-ef6c-4b3c-a1fe-19c49e0ef76d service nova] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5ba49a67-0901-4218-9e7d-fce79516e348 req-8ee04563-ef6c-4b3c-a1fe-19c49e0ef76d service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5ba49a67-0901-4218-9e7d-fce79516e348 req-8ee04563-ef6c-4b3c-a1fe-19c49e0ef76d service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-5ba49a67-0901-4218-9e7d-fce79516e348 req-8ee04563-ef6c-4b3c-a1fe-19c49e0ef76d service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] No waiting events found dispatching network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:19 user nova-compute[72818]: WARNING nova.compute.manager [req-5ba49a67-0901-4218-9e7d-fce79516e348 req-8ee04563-ef6c-4b3c-a1fe-19c49e0ef76d service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received unexpected event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:34:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-55ea7546-61cd-4ceb-bd07-b54b6c07eeff req-21bded07-7c47-483c-bb25-90228a7934da service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-changed-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:20 user nova-compute[72818]: DEBUG nova.compute.manager [req-55ea7546-61cd-4ceb-bd07-b54b6c07eeff req-21bded07-7c47-483c-bb25-90228a7934da service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Refreshing instance network info cache due to event network-changed-758c519d-4502-4a83-9900-5cdfbc22c4f3. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:34:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-55ea7546-61cd-4ceb-bd07-b54b6c07eeff req-21bded07-7c47-483c-bb25-90228a7934da service nova] Acquiring lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:34:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-55ea7546-61cd-4ceb-bd07-b54b6c07eeff req-21bded07-7c47-483c-bb25-90228a7934da service nova] Acquired lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:34:20 user nova-compute[72818]: DEBUG nova.network.neutron [req-55ea7546-61cd-4ceb-bd07-b54b6c07eeff req-21bded07-7c47-483c-bb25-90228a7934da service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Refreshing network info cache for port 758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:34:20 user nova-compute[72818]: DEBUG nova.network.neutron [req-55ea7546-61cd-4ceb-bd07-b54b6c07eeff req-21bded07-7c47-483c-bb25-90228a7934da service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updated VIF entry in instance network info cache for port 758c519d-4502-4a83-9900-5cdfbc22c4f3. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:34:20 user nova-compute[72818]: DEBUG nova.network.neutron [req-55ea7546-61cd-4ceb-bd07-b54b6c07eeff req-21bded07-7c47-483c-bb25-90228a7934da service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updating instance_info_cache with network_info: [{"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:34:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-55ea7546-61cd-4ceb-bd07-b54b6c07eeff req-21bded07-7c47-483c-bb25-90228a7934da service nova] Releasing lock "refresh_cache-1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:34:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-caec2d55-4a6f-4816-861e-b125e33dfeb3 req-a88ccc17-f4f9-4f5a-9218-d72689060eaa service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-caec2d55-4a6f-4816-861e-b125e33dfeb3 req-a88ccc17-f4f9-4f5a-9218-d72689060eaa service nova] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-caec2d55-4a6f-4816-861e-b125e33dfeb3 req-a88ccc17-f4f9-4f5a-9218-d72689060eaa service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-caec2d55-4a6f-4816-861e-b125e33dfeb3 req-a88ccc17-f4f9-4f5a-9218-d72689060eaa service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-caec2d55-4a6f-4816-861e-b125e33dfeb3 req-a88ccc17-f4f9-4f5a-9218-d72689060eaa service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] No waiting events found dispatching network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:21 user nova-compute[72818]: WARNING nova.compute.manager [req-caec2d55-4a6f-4816-861e-b125e33dfeb3 req-a88ccc17-f4f9-4f5a-9218-d72689060eaa service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received unexpected event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:34:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-caec2d55-4a6f-4816-861e-b125e33dfeb3 req-a88ccc17-f4f9-4f5a-9218-d72689060eaa service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-caec2d55-4a6f-4816-861e-b125e33dfeb3 req-a88ccc17-f4f9-4f5a-9218-d72689060eaa service nova] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-caec2d55-4a6f-4816-861e-b125e33dfeb3 req-a88ccc17-f4f9-4f5a-9218-d72689060eaa service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-caec2d55-4a6f-4816-861e-b125e33dfeb3 req-a88ccc17-f4f9-4f5a-9218-d72689060eaa service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-caec2d55-4a6f-4816-861e-b125e33dfeb3 req-a88ccc17-f4f9-4f5a-9218-d72689060eaa service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] No waiting events found dispatching network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:21 user nova-compute[72818]: WARNING nova.compute.manager [req-caec2d55-4a6f-4816-861e-b125e33dfeb3 req-a88ccc17-f4f9-4f5a-9218-d72689060eaa service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received unexpected event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 for instance with vm_state rescued and task_state unrescuing.
Aug 17 21:34:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 21:34:21 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308061.9446034, 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:34:21 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] VM Resumed (Lifecycle Event)
Aug 17 21:34:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8cb0960a-7e91-4f64-941c-b56594bce2b8 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:34:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:34:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:34:21 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 21:34:21 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308061.9456692, 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:34:21 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] VM Started (Lifecycle Event)
Aug 17 21:34:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:34:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:34:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:26 user nova-compute[72818]: INFO nova.compute.manager [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Terminating instance
Aug 17 21:34:26 user nova-compute[72818]: DEBUG nova.compute.manager [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-0b25cbec-7e75-48cb-bc21-c58443e04c6d req-30487ebe-efbb-4786-95ba-c1e1245d8391 service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Received event network-vif-unplugged-ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0b25cbec-7e75-48cb-bc21-c58443e04c6d req-30487ebe-efbb-4786-95ba-c1e1245d8391 service nova] Acquiring lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0b25cbec-7e75-48cb-bc21-c58443e04c6d req-30487ebe-efbb-4786-95ba-c1e1245d8391 service nova] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0b25cbec-7e75-48cb-bc21-c58443e04c6d req-30487ebe-efbb-4786-95ba-c1e1245d8391 service nova] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-0b25cbec-7e75-48cb-bc21-c58443e04c6d req-30487ebe-efbb-4786-95ba-c1e1245d8391 service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] No waiting events found dispatching network-vif-unplugged-ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-0b25cbec-7e75-48cb-bc21-c58443e04c6d req-30487ebe-efbb-4786-95ba-c1e1245d8391 service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Received event network-vif-unplugged-ff5905b9-ac5a-454f-9259-5a2a368e56e1 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "b9a0da7f-47b4-467f-944d-49adac671a06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "b9a0da7f-47b4-467f-944d-49adac671a06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:27 user nova-compute[72818]: INFO nova.compute.manager [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Terminating instance
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:27 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Instance destroyed successfully.
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.objects.instance [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lazy-loading 'resources' on Instance uuid 56115fdf-0fdd-4cce-9ae0-6046422f0a56 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-464628563',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-464628563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4646285',id=32,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzQ+LlCVfXbGq9vgal2PjXmP9MW9II1D8FHFfgZSQldnhfOaEVBVTS/ITiEba2ePvxBg6/eKGe80Rz0nTucF624iPRxkL0rZqbXWc8C7AaH3uHDXEiNMn2DBtp2Wwj3BQ==',key_name='tempest-keypair-1742254251',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:31:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4157791638140e8b3d82e46a4e86d46',ramdisk_id='',reservation_id='r-dcnpigfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2016053776',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:31:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3f15f3e00b74f6daf091110f53fa137',uuid=56115fdf-0fdd-4cce-9ae0-6046422f0a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "address": "fa:16:3e:82:e1:d4", "network": {"id": "d2c00f25-1657-4d58-afd2-bf48698d2457", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109276971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4157791638140e8b3d82e46a4e86d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5905b9-ac", "ovs_interfaceid": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Converting VIF {"id": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "address": "fa:16:3e:82:e1:d4", "network": {"id": "d2c00f25-1657-4d58-afd2-bf48698d2457", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2109276971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4157791638140e8b3d82e46a4e86d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5905b9-ac", "ovs_interfaceid": "ff5905b9-ac5a-454f-9259-5a2a368e56e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:e1:d4,bridge_name='br-int',has_traffic_filtering=True,id=ff5905b9-ac5a-454f-9259-5a2a368e56e1,network=Network(d2c00f25-1657-4d58-afd2-bf48698d2457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5905b9-ac') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG os_vif [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:e1:d4,bridge_name='br-int',has_traffic_filtering=True,id=ff5905b9-ac5a-454f-9259-5a2a368e56e1,network=Network(d2c00f25-1657-4d58-afd2-bf48698d2457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5905b9-ac') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff5905b9-ac, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:27 user nova-compute[72818]: INFO os_vif [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:e1:d4,bridge_name='br-int',has_traffic_filtering=True,id=ff5905b9-ac5a-454f-9259-5a2a368e56e1,network=Network(d2c00f25-1657-4d58-afd2-bf48698d2457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5905b9-ac')
Aug 17 21:34:27 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Deleting instance files /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56_del
Aug 17 21:34:27 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Deletion of /opt/stack/data/nova/instances/56115fdf-0fdd-4cce-9ae0-6046422f0a56_del complete
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.compute.manager [req-27e341b1-39fb-40db-8a93-a150a52a5ac0 req-6ea5cf51-e002-496c-8a56-7fa7945afd59 service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Received event network-vif-unplugged-46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-27e341b1-39fb-40db-8a93-a150a52a5ac0 req-6ea5cf51-e002-496c-8a56-7fa7945afd59 service nova] Acquiring lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-27e341b1-39fb-40db-8a93-a150a52a5ac0 req-6ea5cf51-e002-496c-8a56-7fa7945afd59 service nova] Lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-27e341b1-39fb-40db-8a93-a150a52a5ac0 req-6ea5cf51-e002-496c-8a56-7fa7945afd59 service nova] Lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.compute.manager [req-27e341b1-39fb-40db-8a93-a150a52a5ac0 req-6ea5cf51-e002-496c-8a56-7fa7945afd59 service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] No waiting events found dispatching network-vif-unplugged-46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.compute.manager [req-27e341b1-39fb-40db-8a93-a150a52a5ac0 req-6ea5cf51-e002-496c-8a56-7fa7945afd59 service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Received event network-vif-unplugged-46d37cbb-49e1-4c67-b399-8a1008e611ff for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:34:27 user nova-compute[72818]: INFO nova.compute.manager [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 21:34:27 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:34:27 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Instance destroyed successfully.
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lazy-loading 'resources' on Instance uuid b9a0da7f-47b4-467f-944d-49adac671a06 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1562943068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1562943068',id=2,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:15:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dda0b81a8a39436a9ec6e1646090f637',ramdisk_id='',reservation_id='r-kkbximac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:16:45Z,user_data=None,user_id='6cd1f219a2634975bb1362620392dc1a',uuid=b9a0da7f-47b4-467f-944d-49adac671a06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converting VIF {"id": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "address": "fa:16:3e:51:68:9d", "network": {"id": "e20b460f-ebaa-4140-a71e-e5c803f609fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-901542846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda0b81a8a39436a9ec6e1646090f637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d37cbb-49", "ovs_interfaceid": "46d37cbb-49e1-4c67-b399-8a1008e611ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=46d37cbb-49e1-4c67-b399-8a1008e611ff,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d37cbb-49') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG os_vif [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=46d37cbb-49e1-4c67-b399-8a1008e611ff,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d37cbb-49') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46d37cbb-49, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:34:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:27 user nova-compute[72818]: INFO os_vif [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=46d37cbb-49e1-4c67-b399-8a1008e611ff,network=Network(e20b460f-ebaa-4140-a71e-e5c803f609fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d37cbb-49')
Aug 17 21:34:27 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Deleting instance files /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06_del
Aug 17 21:34:27 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Deletion of /opt/stack/data/nova/instances/b9a0da7f-47b4-467f-944d-49adac671a06_del complete
Aug 17 21:34:28 user nova-compute[72818]: INFO nova.compute.manager [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 21:34:28 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:34:28 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:34:28 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:34:28 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:34:28 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Took 0.84 seconds to deallocate network for instance.
Aug 17 21:34:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:28 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:34:28 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Took 0.66 seconds to deallocate network for instance.
Aug 17 21:34:28 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:34:28 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:34:28 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308053.7486076, b26cd058-5116-476d-abc9-ee3d273bbe20 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:34:28 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] VM Stopped (Lifecycle Event)
Aug 17 21:34:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-5080baa4-e709-4775-abad-3aecc07d1208 None None] [instance: b26cd058-5116-476d-abc9-ee3d273bbe20] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:34:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:28 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Deleted allocations for instance 56115fdf-0fdd-4cce-9ae0-6046422f0a56
Aug 17 21:34:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4ac76853-65ab-4589-a6f0-7bc97ef071af tempest-TestServerVolumeAttachScenarioOldVersion-2016053776 tempest-TestServerVolumeAttachScenarioOldVersion-2016053776-project-member] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.416s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-8489cb6f-e733-451d-8a8b-5d14dc146303 req-031a069d-08c6-4fa1-8acd-4bbc067d831f service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Received event network-vif-plugged-ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8489cb6f-e733-451d-8a8b-5d14dc146303 req-031a069d-08c6-4fa1-8acd-4bbc067d831f service nova] Acquiring lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8489cb6f-e733-451d-8a8b-5d14dc146303 req-031a069d-08c6-4fa1-8acd-4bbc067d831f service nova] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8489cb6f-e733-451d-8a8b-5d14dc146303 req-031a069d-08c6-4fa1-8acd-4bbc067d831f service nova] Lock "56115fdf-0fdd-4cce-9ae0-6046422f0a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:29 user nova-compute[72818]: DEBUG nova.compute.manager [req-8489cb6f-e733-451d-8a8b-5d14dc146303 req-031a069d-08c6-4fa1-8acd-4bbc067d831f service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] No waiting events found dispatching network-vif-plugged-ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:29 user nova-compute[72818]: WARNING nova.compute.manager [req-8489cb6f-e733-451d-8a8b-5d14dc146303 req-031a069d-08c6-4fa1-8acd-4bbc067d831f service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Received unexpected event network-vif-plugged-ff5905b9-ac5a-454f-9259-5a2a368e56e1 for instance with vm_state deleted and task_state None.
Aug 17 21:34:29 user nova-compute[72818]: DEBUG nova.compute.manager [req-8489cb6f-e733-451d-8a8b-5d14dc146303 req-031a069d-08c6-4fa1-8acd-4bbc067d831f service nova] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Received event network-vif-deleted-ff5905b9-ac5a-454f-9259-5a2a368e56e1 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:29 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:34:29 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:34:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:29 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Deleted allocations for instance b9a0da7f-47b4-467f-944d-49adac671a06
Aug 17 21:34:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b7e18b55-4bbe-4330-b9c1-06f8024a5c8e tempest-ServerBootFromVolumeStableRescueTest-1074783662 tempest-ServerBootFromVolumeStableRescueTest-1074783662-project-member] Lock "b9a0da7f-47b4-467f-944d-49adac671a06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.061s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:29 user nova-compute[72818]: DEBUG nova.compute.manager [req-880bc1ca-bccb-4c66-b95c-1d4662c6f468 req-d72c3945-2f34-4182-984e-a08e954f2c10 service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Received event network-vif-plugged-46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-880bc1ca-bccb-4c66-b95c-1d4662c6f468 req-d72c3945-2f34-4182-984e-a08e954f2c10 service nova] Acquiring lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-880bc1ca-bccb-4c66-b95c-1d4662c6f468 req-d72c3945-2f34-4182-984e-a08e954f2c10 service nova] Lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-880bc1ca-bccb-4c66-b95c-1d4662c6f468 req-d72c3945-2f34-4182-984e-a08e954f2c10 service nova] Lock "b9a0da7f-47b4-467f-944d-49adac671a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:29 user nova-compute[72818]: DEBUG nova.compute.manager [req-880bc1ca-bccb-4c66-b95c-1d4662c6f468 req-d72c3945-2f34-4182-984e-a08e954f2c10 service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] No waiting events found dispatching network-vif-plugged-46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:29 user nova-compute[72818]: WARNING nova.compute.manager [req-880bc1ca-bccb-4c66-b95c-1d4662c6f468 req-d72c3945-2f34-4182-984e-a08e954f2c10 service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Received unexpected event network-vif-plugged-46d37cbb-49e1-4c67-b399-8a1008e611ff for instance with vm_state deleted and task_state None.
Aug 17 21:34:29 user nova-compute[72818]: DEBUG nova.compute.manager [req-880bc1ca-bccb-4c66-b95c-1d4662c6f468 req-d72c3945-2f34-4182-984e-a08e954f2c10 service nova] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Received event network-vif-deleted-46d37cbb-49e1-4c67-b399-8a1008e611ff {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:40 user nova-compute[72818]: INFO nova.compute.manager [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Terminating instance
Aug 17 21:34:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-cb942225-6324-4c31-81f8-893de43a6374 req-aa22a11c-33f6-4539-97f2-91e8298fb867 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-unplugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cb942225-6324-4c31-81f8-893de43a6374 req-aa22a11c-33f6-4539-97f2-91e8298fb867 service nova] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cb942225-6324-4c31-81f8-893de43a6374 req-aa22a11c-33f6-4539-97f2-91e8298fb867 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cb942225-6324-4c31-81f8-893de43a6374 req-aa22a11c-33f6-4539-97f2-91e8298fb867 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-cb942225-6324-4c31-81f8-893de43a6374 req-aa22a11c-33f6-4539-97f2-91e8298fb867 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] No waiting events found dispatching network-vif-unplugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-cb942225-6324-4c31-81f8-893de43a6374 req-aa22a11c-33f6-4539-97f2-91e8298fb867 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-unplugged-ff979858-3d61-4234-b7fc-f3f738f6e640 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Instance destroyed successfully.
Aug 17 21:34:41 user nova-compute[72818]: DEBUG nova.objects.instance [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'resources' on Instance uuid e15761ac-028d-40a9-931d-51ef8b77c1cf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:34:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2146804663',display_name='tempest-ServerRescueNegativeTestJSON-server-2146804663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2146804663',id=28,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV/pS7wUhm0egVv1NtGbx5/2A1E7cbIE5hKV5ijlKQsvO0xKD4ofO5CI2bFHmvs/MMU7DPVxjfa7iDVYpJ0GH7ksRIf1X2CzuVLFIO0pnHBbe6SeUNRQnv5JLq6KDzMyQ==',key_name='tempest-keypair-70771550',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:30:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f6bdddb43364e86b302c9c2e273fd44',ramdisk_id='',reservation_id='r-s734dqvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-713886303',owner_user_name='tempest-ServerRescueNegativeTestJSON-713886303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa40080d9842b1a4f6a3e041b5d123',uuid=e15761ac-028d-40a9-931d-51ef8b77c1cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:34:41 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converting VIF {"id": "ff979858-3d61-4234-b7fc-f3f738f6e640", "address": "fa:16:3e:c4:d9:ba", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff979858-3d", "ovs_interfaceid": "ff979858-3d61-4234-b7fc-f3f738f6e640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:34:41 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:d9:ba,bridge_name='br-int',has_traffic_filtering=True,id=ff979858-3d61-4234-b7fc-f3f738f6e640,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff979858-3d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:34:41 user nova-compute[72818]: DEBUG os_vif [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:d9:ba,bridge_name='br-int',has_traffic_filtering=True,id=ff979858-3d61-4234-b7fc-f3f738f6e640,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff979858-3d') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:34:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff979858-3d, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:34:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:34:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:41 user nova-compute[72818]: INFO os_vif [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:d9:ba,bridge_name='br-int',has_traffic_filtering=True,id=ff979858-3d61-4234-b7fc-f3f738f6e640,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff979858-3d')
Aug 17 21:34:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Deleting instance files /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf_del
Aug 17 21:34:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Deletion of /opt/stack/data/nova/instances/e15761ac-028d-40a9-931d-51ef8b77c1cf_del complete
Aug 17 21:34:41 user nova-compute[72818]: INFO nova.compute.manager [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 21:34:41 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:34:41 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:34:41 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:34:42 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Took 0.82 seconds to deallocate network for instance.
Aug 17 21:34:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-9ce345a2-d14f-40d2-8cc0-8eb949423fdf req-403305b4-ad80-4395-86d5-846f13329cfb service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-deleted-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:42 user nova-compute[72818]: INFO nova.compute.manager [req-9ce345a2-d14f-40d2-8cc0-8eb949423fdf req-403305b4-ad80-4395-86d5-846f13329cfb service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Neutron deleted interface ff979858-3d61-4234-b7fc-f3f738f6e640; detaching it from the instance and deleting it from the info cache
Aug 17 21:34:42 user nova-compute[72818]: DEBUG nova.network.neutron [req-9ce345a2-d14f-40d2-8cc0-8eb949423fdf req-403305b4-ad80-4395-86d5-846f13329cfb service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-9ce345a2-d14f-40d2-8cc0-8eb949423fdf req-403305b4-ad80-4395-86d5-846f13329cfb service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Detach interface failed, port_id=ff979858-3d61-4234-b7fc-f3f738f6e640, reason: Instance e15761ac-028d-40a9-931d-51ef8b77c1cf could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308067.37631, 56115fdf-0fdd-4cce-9ae0-6046422f0a56 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:34:42 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] VM Stopped (Lifecycle Event)
Aug 17 21:34:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-017fca06-2f60-4869-93fa-64f9c3588c45 None None] [instance: 56115fdf-0fdd-4cce-9ae0-6046422f0a56] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:42 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Deleted allocations for instance e15761ac-028d-40a9-931d-51ef8b77c1cf
Aug 17 21:34:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a64a8df7-00c1-4b67-ac13-ce7602e6ae9a tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.113s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-579f815c-7fb2-466b-8a8f-4da024d69796 req-98c8abdb-bee1-41c5-b630-c2d597f2a765 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-579f815c-7fb2-466b-8a8f-4da024d69796 req-98c8abdb-bee1-41c5-b630-c2d597f2a765 service nova] Acquiring lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-579f815c-7fb2-466b-8a8f-4da024d69796 req-98c8abdb-bee1-41c5-b630-c2d597f2a765 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-579f815c-7fb2-466b-8a8f-4da024d69796 req-98c8abdb-bee1-41c5-b630-c2d597f2a765 service nova] Lock "e15761ac-028d-40a9-931d-51ef8b77c1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-579f815c-7fb2-466b-8a8f-4da024d69796 req-98c8abdb-bee1-41c5-b630-c2d597f2a765 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] No waiting events found dispatching network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:34:42 user nova-compute[72818]: WARNING nova.compute.manager [req-579f815c-7fb2-466b-8a8f-4da024d69796 req-98c8abdb-bee1-41c5-b630-c2d597f2a765 service nova] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Received unexpected event network-vif-plugged-ff979858-3d61-4234-b7fc-f3f738f6e640 for instance with vm_state deleted and task_state None.
Aug 17 21:34:42 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308067.9437332, b9a0da7f-47b4-467f-944d-49adac671a06 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:34:42 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] VM Stopped (Lifecycle Event)
Aug 17 21:34:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-a632937a-fe1f-4c7d-be8e-7c53345ed210 None None] [instance: b9a0da7f-47b4-467f-944d-49adac671a06] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:34:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:34:50 user nova-compute[72818]: INFO nova.compute.manager [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Detaching volume cbf9a25d-02ce-44f9-9cde-6dff6ed329cc
Aug 17 21:34:50 user nova-compute[72818]: INFO nova.virt.block_device [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Attempting to driver detach volume cbf9a25d-02ce-44f9-9cde-6dff6ed329cc from mountpoint /dev/vdb
Aug 17 21:34:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Attempting to detach device vdb from instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:34:50 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:34:50 user nova-compute[72818]:   <source dev="/dev/sdf"/>
Aug 17 21:34:50 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:34:50 user nova-compute[72818]:   <serial>cbf9a25d-02ce-44f9-9cde-6dff6ed329cc</serial>
Aug 17 21:34:50 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:34:50 user nova-compute[72818]: </disk>
Aug 17 21:34:50 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:34:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Successfully detached device vdb from instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 from the persistent domain config.
Aug 17 21:34:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:34:50 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:34:50 user nova-compute[72818]:   <source dev="/dev/sdf"/>
Aug 17 21:34:50 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:34:50 user nova-compute[72818]:   <serial>cbf9a25d-02ce-44f9-9cde-6dff6ed329cc</serial>
Aug 17 21:34:50 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:34:50 user nova-compute[72818]: </disk>
Aug 17 21:34:50 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308090.700994, 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:34:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Successfully detached device vdb from instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 from the live domain config.
Aug 17 21:34:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKVtlRDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:34:50 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[58685536-fb73-4eaa-a265-6aee9aed61bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[530073b0-f8d6-4737-a9c7-36a00bd5c618]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:34:50 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:34:50 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:34:50 user nova-compute[72818]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc (non-flash)
Aug 17 21:34:50 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04c06560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc'): ({'sdf'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Removing single pathed devices sdf {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ccc0d9-84ee-466a-b977-0aaf14d41554]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a44b914-977f-4c46-971d-8a7fea8a9276]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Flushing IO for device /dev/sdf {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4b6b7c-77d1-4eff-9111-b3cd97a66f5b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e282b9-019e-4344-b498-1b6b164c837b]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] SCSI volumes sdf have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89c3242-c1ef-4ce1-93f7-1897ba76590e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[15800db0-91bb-4df1-8244-1357384622f8]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc, portal: 172.16.0.220,3260]
Aug 17 21:34:50 user nova-compute[72818]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc, portal: 172.16.0.220,3260] successful.
Aug 17 21:34:50 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf9a25d-02ce-44f9-9cde-6dff6ed329cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dfae5c-0e15-4e4f-b0a0-55bd09567b62]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] <== disconnect_volume: return (257ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:34:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:34:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:51 user nova-compute[72818]: DEBUG nova.objects.instance [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'flavor' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:34:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2ed32410-9d4e-4462-98d6-be2e7737985a tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.583s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:34:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:56 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308081.1902633, e15761ac-028d-40a9-931d-51ef8b77c1cf => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:34:56 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] VM Stopped (Lifecycle Event)
Aug 17 21:34:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b458a388-9b61-4fb4-aced-a70e52aef670 None None] [instance: e15761ac-028d-40a9-931d-51ef8b77c1cf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:34:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:34:59 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:35:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:35:05 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:35:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:35:07 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:35:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:35:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:35:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:35:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:35:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Updating instance_info_cache with network_info: [{"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:35:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:35:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:35:08 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:35:08 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:35:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:35:09 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:35:09 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:35:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:09 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:35:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "61d219ec-0254-41a1-8b53-9177cfe9b585" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:09 user nova-compute[72818]: INFO nova.compute.manager [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Terminating instance
Aug 17 21:35:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:35:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-c072fe65-71db-498e-8fac-771666d1c5af req-dfe49a15-92dc-4a9d-bc8d-5c899a0f1e29 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Received event network-vif-unplugged-24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c072fe65-71db-498e-8fac-771666d1c5af req-dfe49a15-92dc-4a9d-bc8d-5c899a0f1e29 service nova] Acquiring lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c072fe65-71db-498e-8fac-771666d1c5af req-dfe49a15-92dc-4a9d-bc8d-5c899a0f1e29 service nova] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c072fe65-71db-498e-8fac-771666d1c5af req-dfe49a15-92dc-4a9d-bc8d-5c899a0f1e29 service nova] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-c072fe65-71db-498e-8fac-771666d1c5af req-dfe49a15-92dc-4a9d-bc8d-5c899a0f1e29 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] No waiting events found dispatching network-vif-unplugged-24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-c072fe65-71db-498e-8fac-771666d1c5af req-dfe49a15-92dc-4a9d-bc8d-5c899a0f1e29 service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Received event network-vif-unplugged-24416426-2fb4-4a5c-bd06-d2e3aee656e7 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:10 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Instance destroyed successfully.
Aug 17 21:35:10 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lazy-loading 'resources' on Instance uuid 61d219ec-0254-41a1-8b53-9177cfe9b585 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:30:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1927687644',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1927687644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1927687644',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0izqoaOqMe8RGDfeTA4LTdOg2Nkd8TEzLVLsIK7suEm2g3Ne3+GTe9cQuNzjREiuxRh12ZIBNlfCZcPoAgZ5Kavp6Rf96BpOz+py+cmRJsJjylJ5tHvRSbiaEPqdMRiA==',key_name='tempest-keypair-1634734999',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:30:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-ei1bghkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=61d219ec-0254-41a1-8b53-9177cfe9b585,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "address": "fa:16:3e:e7:5c:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24416426-2f", "ovs_interfaceid": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "address": "fa:16:3e:e7:5c:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24416426-2f", "ovs_interfaceid": "24416426-2fb4-4a5c-bd06-d2e3aee656e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=24416426-2fb4-4a5c-bd06-d2e3aee656e7,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24416426-2f') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_vif [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=24416426-2fb4-4a5c-bd06-d2e3aee656e7,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24416426-2f') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24416426-2f, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:10 user nova-compute[72818]: INFO os_vif [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=24416426-2fb4-4a5c-bd06-d2e3aee656e7,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24416426-2f')
Aug 17 21:35:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZkbdeJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:35:10 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c32dd4-1186-4ccc-a528-127e20a9b034]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afdef7e-cff8-4638-97f2-2cb07464af39]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:35:10 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 (non-flash)
Aug 17 21:35:10 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04f23640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42'): ({'sde'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Removing single pathed devices sde {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82168e6-68df-4563-a56d-4810726bedd1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b353cefe-50d3-44dc-a288-021c0bd5631b]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flushing IO for device /dev/sde {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d1ea41-207b-40b8-b213-38d17c445758]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f02dce-37c5-422f-beec-32e40ee86ee6]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] SCSI volumes sde have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[759debda-685b-4274-b61b-29dfe8c9bd79]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b048a12a-dfc2-4bef-8fb5-746b3c2558a2]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42, portal: 172.16.0.220,3260]
Aug 17 21:35:10 user nova-compute[72818]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42, portal: 172.16.0.220,3260] successful.
Aug 17 21:35:10 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:35:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f23a3f-f895-48f1-8e1a-a894d968dd42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eb1a86-6a37-48df-b728-507743c418d5]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== disconnect_volume: return (276ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:35:11 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Deleting instance files /opt/stack/data/nova/instances/61d219ec-0254-41a1-8b53-9177cfe9b585_del
Aug 17 21:35:11 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Deletion of /opt/stack/data/nova/instances/61d219ec-0254-41a1-8b53-9177cfe9b585_del complete
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:11 user nova-compute[72818]: INFO nova.compute.manager [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-0a729363-083d-45e3-b44d-f4aa5cf81285 req-d3f1bad5-8668-4fb3-8e24-0844558ecb2a service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Received event network-vif-deleted-24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:11 user nova-compute[72818]: INFO nova.compute.manager [req-0a729363-083d-45e3-b44d-f4aa5cf81285 req-d3f1bad5-8668-4fb3-8e24-0844558ecb2a service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Neutron deleted interface 24416426-2fb4-4a5c-bd06-d2e3aee656e7; detaching it from the instance and deleting it from the info cache
Aug 17 21:35:11 user nova-compute[72818]: DEBUG nova.network.neutron [req-0a729363-083d-45e3-b44d-f4aa5cf81285 req-d3f1bad5-8668-4fb3-8e24-0844558ecb2a service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:35:11 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Took 0.84 seconds to deallocate network for instance.
Aug 17 21:35:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-0a729363-083d-45e3-b44d-f4aa5cf81285 req-d3f1bad5-8668-4fb3-8e24-0844558ecb2a service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Detach interface failed, port_id=24416426-2fb4-4a5c-bd06-d2e3aee656e7, reason: Instance 61d219ec-0254-41a1-8b53-9177cfe9b585 could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-b1612046-aa64-4322-85e5-35cf5803f99e req-f7d154ca-0ab0-4fd1-886e-f0f015a173dc service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Received event network-vif-plugged-24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b1612046-aa64-4322-85e5-35cf5803f99e req-f7d154ca-0ab0-4fd1-886e-f0f015a173dc service nova] Acquiring lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b1612046-aa64-4322-85e5-35cf5803f99e req-f7d154ca-0ab0-4fd1-886e-f0f015a173dc service nova] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b1612046-aa64-4322-85e5-35cf5803f99e req-f7d154ca-0ab0-4fd1-886e-f0f015a173dc service nova] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:12 user nova-compute[72818]: DEBUG nova.compute.manager [req-b1612046-aa64-4322-85e5-35cf5803f99e req-f7d154ca-0ab0-4fd1-886e-f0f015a173dc service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] No waiting events found dispatching network-vif-plugged-24416426-2fb4-4a5c-bd06-d2e3aee656e7 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:12 user nova-compute[72818]: WARNING nova.compute.manager [req-b1612046-aa64-4322-85e5-35cf5803f99e req-f7d154ca-0ab0-4fd1-886e-f0f015a173dc service nova] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Received unexpected event network-vif-plugged-24416426-2fb4-4a5c-bd06-d2e3aee656e7 for instance with vm_state active and task_state deleting.
Aug 17 21:35:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:12 user nova-compute[72818]: INFO nova.compute.manager [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Took 0.97 seconds to detach 1 volumes for instance.
Aug 17 21:35:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Deleting volume: 91f23a3f-f895-48f1-8e1a-a894d968dd42 {{(pid=72818) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 21:35:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:35:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:35:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8163MB free_disk=25.28451919555664GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:35:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Applying migration context for instance 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a as it has an incoming, in-progress migration 6862d14a-ac1c-4b2c-9c1a-8ddbf8d5ad14. Migration status is error {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=72818) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 61d219ec-0254-41a1-8b53-9177cfe9b585 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.241s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:35:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:13 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Deleted allocations for instance 61d219ec-0254-41a1-8b53-9177cfe9b585
Aug 17 21:35:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7ac7696e-25da-4742-8a19-189019d16474 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "61d219ec-0254-41a1-8b53-9177cfe9b585" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.782s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:21 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:35:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:25 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308110.6303828, 61d219ec-0254-41a1-8b53-9177cfe9b585 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:35:25 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] VM Stopped (Lifecycle Event)
Aug 17 21:35:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3ee8ed4d-d4fc-46a2-86d6-d94bf7d67742 None None] [instance: 61d219ec-0254-41a1-8b53-9177cfe9b585] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:35:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "284e9f53-7677-4f21-b998-759f1d151f9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:35:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:33 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:35:33 user nova-compute[72818]: INFO nova.compute.claims [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Claim successful on node user
Aug 17 21:35:33 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:35:33 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:35:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:35:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:35:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:35:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:35:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:35:33 user nova-compute[72818]: DEBUG nova.policy [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbcc7e79679c4ebb915828988321acc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9d9dc56ba84253be502280f64d7b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:35:34 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Creating image(s)
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "/opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "/opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "/opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.169s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk 1073741824" returned: 0 in 0.065s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Successfully created port: 5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.204s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Checking if we can resize image /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Cannot resize image /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG nova.objects.instance [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'migration_context' on Instance uuid 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Ensure instance console log exists: /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Successfully updated port: 5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquired lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.compute.manager [req-e4aea423-8f0c-45ac-9d77-5402b39a6073 req-8c3aa5c1-e704-4a49-b11b-6f6d61b859a0 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-changed-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.compute.manager [req-e4aea423-8f0c-45ac-9d77-5402b39a6073 req-8c3aa5c1-e704-4a49-b11b-6f6d61b859a0 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Refreshing instance network info cache due to event network-changed-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e4aea423-8f0c-45ac-9d77-5402b39a6073 req-8c3aa5c1-e704-4a49-b11b-6f6d61b859a0 service nova] Acquiring lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updating instance_info_cache with network_info: [{"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Releasing lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Instance network_info: |[{"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e4aea423-8f0c-45ac-9d77-5402b39a6073 req-8c3aa5c1-e704-4a49-b11b-6f6d61b859a0 service nova] Acquired lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-e4aea423-8f0c-45ac-9d77-5402b39a6073 req-8c3aa5c1-e704-4a49-b11b-6f6d61b859a0 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Refreshing network info cache for port 5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Start _get_guest_xml network_info=[{"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:35:35 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:35:35 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1471917594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1471917594',id=35,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHo2Z6RZPRkdg03MXM22dNzinbjZ9356gsX/8BwOTg5F2VFak9gkLfvjkT7eCvd5roCAlsS1utAeXUkNyKMF86k+fZUWgs05GSc3LmYrb+1Yh4jeColgmVjndZWFXEZOg==',key_name='tempest-keypair-8619247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a9d9dc56ba84253be502280f64d7b59',ramdisk_id='',reservation_id='r-06vbaj3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-895220279',owner_user_name='tempest-AttachVolumeShelveTestJSON-895220279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:35:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcc7e79679c4ebb915828988321acc8',uuid=284e9f53-7677-4f21-b998-759f1d151f9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converting VIF {"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.objects.instance [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'pci_devices' on Instance uuid 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:35:35 user nova-compute[72818]:   <uuid>284e9f53-7677-4f21-b998-759f1d151f9d</uuid>
Aug 17 21:35:35 user nova-compute[72818]:   <name>instance-00000023</name>
Aug 17 21:35:35 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:35:35 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:35:35 user nova-compute[72818]:   <metadata>
Aug 17 21:35:35 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:35:35 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:35:35 user nova-compute[72818]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1471917594</nova:name>
Aug 17 21:35:35 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:35:35</nova:creationTime>
Aug 17 21:35:35 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:35:35 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:35:35 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:35:35 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:35:35 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:35:35 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:35:35 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:35:35 user nova-compute[72818]:       <nova:owner>
Aug 17 21:35:35 user nova-compute[72818]:         <nova:user uuid="fbcc7e79679c4ebb915828988321acc8">tempest-AttachVolumeShelveTestJSON-895220279-project-member</nova:user>
Aug 17 21:35:35 user nova-compute[72818]:         <nova:project uuid="4a9d9dc56ba84253be502280f64d7b59">tempest-AttachVolumeShelveTestJSON-895220279</nova:project>
Aug 17 21:35:35 user nova-compute[72818]:       </nova:owner>
Aug 17 21:35:35 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:35:35 user nova-compute[72818]:       <nova:ports>
Aug 17 21:35:35 user nova-compute[72818]:         <nova:port uuid="5b51c2ed-5dd4-461f-9c75-0ef59e66b00f">
Aug 17 21:35:35 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 21:35:35 user nova-compute[72818]:         </nova:port>
Aug 17 21:35:35 user nova-compute[72818]:       </nova:ports>
Aug 17 21:35:35 user nova-compute[72818]:     </nova:instance>
Aug 17 21:35:35 user nova-compute[72818]:   </metadata>
Aug 17 21:35:35 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:35:35 user nova-compute[72818]:     <system>
Aug 17 21:35:35 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:35:35 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:35:35 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:35:35 user nova-compute[72818]:       <entry name="serial">284e9f53-7677-4f21-b998-759f1d151f9d</entry>
Aug 17 21:35:35 user nova-compute[72818]:       <entry name="uuid">284e9f53-7677-4f21-b998-759f1d151f9d</entry>
Aug 17 21:35:35 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:35:35 user nova-compute[72818]:     </system>
Aug 17 21:35:35 user nova-compute[72818]:   </sysinfo>
Aug 17 21:35:35 user nova-compute[72818]:   <os>
Aug 17 21:35:35 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:35:35 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:35:35 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:35:35 user nova-compute[72818]:   </os>
Aug 17 21:35:35 user nova-compute[72818]:   <features>
Aug 17 21:35:35 user nova-compute[72818]:     <acpi/>
Aug 17 21:35:35 user nova-compute[72818]:     <apic/>
Aug 17 21:35:35 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:35:35 user nova-compute[72818]:   </features>
Aug 17 21:35:35 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:35:35 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:35:35 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:35:35 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:35:35 user nova-compute[72818]:   </clock>
Aug 17 21:35:35 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:35:35 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:35:35 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:35:35 user nova-compute[72818]:   </cpu>
Aug 17 21:35:35 user nova-compute[72818]:   <devices>
Aug 17 21:35:35 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:35:35 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:35:35 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk"/>
Aug 17 21:35:35 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:35:35 user nova-compute[72818]:     </disk>
Aug 17 21:35:35 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:35:35 user nova-compute[72818]:       <mac address="fa:16:3e:71:15:5a"/>
Aug 17 21:35:35 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:35:35 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:35:35 user nova-compute[72818]:       <target dev="tap5b51c2ed-5d"/>
Aug 17 21:35:35 user nova-compute[72818]:     </interface>
Aug 17 21:35:35 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:35:35 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/console.log" append="off"/>
Aug 17 21:35:35 user nova-compute[72818]:     </serial>
Aug 17 21:35:35 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:35:35 user nova-compute[72818]:     <video>
Aug 17 21:35:35 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:35:35 user nova-compute[72818]:     </video>
Aug 17 21:35:35 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:35:35 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:35:35 user nova-compute[72818]:     </rng>
Aug 17 21:35:35 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:35:35 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:35:35 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:35:35 user nova-compute[72818]:     </memballoon>
Aug 17 21:35:35 user nova-compute[72818]:   </devices>
Aug 17 21:35:35 user nova-compute[72818]: </domain>
Aug 17 21:35:35 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1471917594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1471917594',id=35,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHo2Z6RZPRkdg03MXM22dNzinbjZ9356gsX/8BwOTg5F2VFak9gkLfvjkT7eCvd5roCAlsS1utAeXUkNyKMF86k+fZUWgs05GSc3LmYrb+1Yh4jeColgmVjndZWFXEZOg==',key_name='tempest-keypair-8619247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a9d9dc56ba84253be502280f64d7b59',ramdisk_id='',reservation_id='r-06vbaj3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-895220279',owner_user_name='tempest-AttachVolumeShelveTestJSON-895220279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:35:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcc7e79679c4ebb915828988321acc8',uuid=284e9f53-7677-4f21-b998-759f1d151f9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converting VIF {"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG os_vif [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b51c2ed-5d, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b51c2ed-5d, col_values=(('external_ids', {'iface-id': '5b51c2ed-5dd4-461f-9c75-0ef59e66b00f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:15:5a', 'vm-uuid': '284e9f53-7677-4f21-b998-759f1d151f9d'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:35:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:35 user nova-compute[72818]: INFO os_vif [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d')
Aug 17 21:35:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:35:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] No VIF found with MAC fa:16:3e:71:15:5a, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:35:36 user nova-compute[72818]: DEBUG nova.network.neutron [req-e4aea423-8f0c-45ac-9d77-5402b39a6073 req-8c3aa5c1-e704-4a49-b11b-6f6d61b859a0 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updated VIF entry in instance network info cache for port 5b51c2ed-5dd4-461f-9c75-0ef59e66b00f. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:35:36 user nova-compute[72818]: DEBUG nova.network.neutron [req-e4aea423-8f0c-45ac-9d77-5402b39a6073 req-8c3aa5c1-e704-4a49-b11b-6f6d61b859a0 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updating instance_info_cache with network_info: [{"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:35:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e4aea423-8f0c-45ac-9d77-5402b39a6073 req-8c3aa5c1-e704-4a49-b11b-6f6d61b859a0 service nova] Releasing lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-903366a6-dd47-4497-8911-2e8a6bce2f08 req-9c0ffae4-b392-487e-9e50-e91ee1fa6d74 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-903366a6-dd47-4497-8911-2e8a6bce2f08 req-9c0ffae4-b392-487e-9e50-e91ee1fa6d74 service nova] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-903366a6-dd47-4497-8911-2e8a6bce2f08 req-9c0ffae4-b392-487e-9e50-e91ee1fa6d74 service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-903366a6-dd47-4497-8911-2e8a6bce2f08 req-9c0ffae4-b392-487e-9e50-e91ee1fa6d74 service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-903366a6-dd47-4497-8911-2e8a6bce2f08 req-9c0ffae4-b392-487e-9e50-e91ee1fa6d74 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] No waiting events found dispatching network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:37 user nova-compute[72818]: WARNING nova.compute.manager [req-903366a6-dd47-4497-8911-2e8a6bce2f08 req-9c0ffae4-b392-487e-9e50-e91ee1fa6d74 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received unexpected event network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f for instance with vm_state building and task_state spawning.
Aug 17 21:35:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:39 user nova-compute[72818]: INFO nova.compute.manager [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Terminating instance
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.compute.manager [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:35:39 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Instance destroyed successfully.
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.objects.instance [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'resources' on Instance uuid 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:31:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1592742420',display_name='tempest-ServerActionsTestOtherA-server-1592742420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1592742420',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV/yxdZf0gbz0Oc0hEv4WwXP2jV20fy0LitgWYnfEN52KHQjmeuLO48ZiCuSailjRm1wHuszXDlB837Vche8MvGzjfdhLQW/IYo033/9mpCOWKkYkF4Ly8lZgNbXJbUlw==',key_name='tempest-keypair-570023473',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-9abyhwyq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=2e4ea99b-4bfd-4c21-9824-ffa3ad63164a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "address": "fa:16:3e:53:89:2d", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fec2e3-cf", "ovs_interfaceid": "09fec2e3-cf08-428f-991d-a1d4abad7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:89:2d,bridge_name='br-int',has_traffic_filtering=True,id=09fec2e3-cf08-428f-991d-a1d4abad7ca6,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fec2e3-cf') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG os_vif [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:89:2d,bridge_name='br-int',has_traffic_filtering=True,id=09fec2e3-cf08-428f-991d-a1d4abad7ca6,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fec2e3-cf') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09fec2e3-cf, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:35:39 user nova-compute[72818]: INFO os_vif [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:89:2d,bridge_name='br-int',has_traffic_filtering=True,id=09fec2e3-cf08-428f-991d-a1d4abad7ca6,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fec2e3-cf')
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZCsrAIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:35:39 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:35:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f797d56c-78cb-497e-843e-b75c5a86fb43', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[24972d4f-9572-4e8a-b9b5-ab333b58d7f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:35:39 user nova-compute[72818]: WARNING os_brick.initiator.connectors.iscsi [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 17 21:35:39 user nova-compute[72818]: 
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2976cc-4e8c-444d-8daf-c4431351c8f5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:35:39 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:35:39 user nova-compute[72818]:  {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:35:39 user nova-compute[72818]: WARNING os_brick.initiator.connectors.iscsi [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 21:35:39 user nova-compute[72818]: 
Aug 17 21:35:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fa9360>, {}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Disconnecting from: [] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] <== disconnect_volume: return (51ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:35:39 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Deletion of /opt/stack/data/nova/instances/2e4ea99b-4bfd-4c21-9824-ffa3ad63164a_resize failed
Aug 17 21:35:39 user nova-compute[72818]: INFO nova.compute.manager [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Took 0.36 seconds to destroy the instance on the hypervisor.
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.compute.manager [req-7d552297-e559-4f97-b36b-7e9dc2750207 req-43599374-9ebb-49de-935b-f0a30ecfe47a service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7d552297-e559-4f97-b36b-7e9dc2750207 req-43599374-9ebb-49de-935b-f0a30ecfe47a service nova] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7d552297-e559-4f97-b36b-7e9dc2750207 req-43599374-9ebb-49de-935b-f0a30ecfe47a service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7d552297-e559-4f97-b36b-7e9dc2750207 req-43599374-9ebb-49de-935b-f0a30ecfe47a service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.compute.manager [req-7d552297-e559-4f97-b36b-7e9dc2750207 req-43599374-9ebb-49de-935b-f0a30ecfe47a service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] No waiting events found dispatching network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:39 user nova-compute[72818]: WARNING nova.compute.manager [req-7d552297-e559-4f97-b36b-7e9dc2750207 req-43599374-9ebb-49de-935b-f0a30ecfe47a service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received unexpected event network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f for instance with vm_state building and task_state spawning.
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308139.5588436, 284e9f53-7677-4f21-b998-759f1d151f9d => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:35:39 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] VM Resumed (Lifecycle Event)
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:35:39 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Instance spawned successfully.
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:35:39 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308139.5596828, 284e9f53-7677-4f21-b998-759f1d151f9d => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:35:39 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] VM Started (Lifecycle Event)
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:35:39 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:35:39 user nova-compute[72818]: INFO nova.compute.manager [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Took 5.66 seconds to spawn the instance on the hypervisor.
Aug 17 21:35:39 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:35:39 user nova-compute[72818]: INFO nova.compute.manager [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Took 6.36 seconds to build instance.
Aug 17 21:35:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2799d210-1712-4489-b1fd-90f4b23fabd5 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "284e9f53-7677-4f21-b998-759f1d151f9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.455s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:40 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:35:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-d99aef8d-9e14-4b74-b123-968b5cca2592 req-7b19e26d-b03a-4206-b130-a0475fe09add service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Received event network-vif-deleted-09fec2e3-cf08-428f-991d-a1d4abad7ca6 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:40 user nova-compute[72818]: INFO nova.compute.manager [req-d99aef8d-9e14-4b74-b123-968b5cca2592 req-7b19e26d-b03a-4206-b130-a0475fe09add service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Neutron deleted interface 09fec2e3-cf08-428f-991d-a1d4abad7ca6; detaching it from the instance and deleting it from the info cache
Aug 17 21:35:40 user nova-compute[72818]: DEBUG nova.network.neutron [req-d99aef8d-9e14-4b74-b123-968b5cca2592 req-7b19e26d-b03a-4206-b130-a0475fe09add service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:35:40 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Took 1.32 seconds to deallocate network for instance.
Aug 17 21:35:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-d99aef8d-9e14-4b74-b123-968b5cca2592 req-7b19e26d-b03a-4206-b130-a0475fe09add service nova] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Detach interface failed, port_id=09fec2e3-cf08-428f-991d-a1d4abad7ca6, reason: Instance 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:35:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:40 user nova-compute[72818]: INFO nova.compute.manager [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Took 0.16 seconds to detach 1 volumes for instance.
Aug 17 21:35:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Deleting volume: f797d56c-78cb-497e-843e-b75c5a86fb43 {{(pid=72818) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 21:35:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:40 user nova-compute[72818]: INFO nova.compute.manager [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Terminating instance
Aug 17 21:35:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:41 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Deleted allocations for instance 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a
Aug 17 21:35:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-3a801faf-2500-47bd-99e7-aa9881df9cfe req-f36c9112-2463-4636-ae58-302fb7657edf service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-unplugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3a801faf-2500-47bd-99e7-aa9881df9cfe req-f36c9112-2463-4636-ae58-302fb7657edf service nova] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3a801faf-2500-47bd-99e7-aa9881df9cfe req-f36c9112-2463-4636-ae58-302fb7657edf service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3a801faf-2500-47bd-99e7-aa9881df9cfe req-f36c9112-2463-4636-ae58-302fb7657edf service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-3a801faf-2500-47bd-99e7-aa9881df9cfe req-f36c9112-2463-4636-ae58-302fb7657edf service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] No waiting events found dispatching network-vif-unplugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-3a801faf-2500-47bd-99e7-aa9881df9cfe req-f36c9112-2463-4636-ae58-302fb7657edf service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-unplugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1ad15c8d-69f9-4b08-bee7-e8a513c46bf0 tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "2e4ea99b-4bfd-4c21-9824-ffa3ad63164a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.549s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Instance destroyed successfully.
Aug 17 21:35:41 user nova-compute[72818]: DEBUG nova.objects.instance [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lazy-loading 'resources' on Instance uuid 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1442683799',display_name='tempest-ServerStableDeviceRescueTest-server-1442683799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1442683799',id=30,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDwLSGxEukk9sEy04Wrk8OIVuJSzGsPocTfFTy++b8WWPbcEy1LQL4FEUeGxaiUAG+1gM+BfsW0ECiGjCjRoh2wxosjr/MhkzqugFjj2zenjFJHhT+ObJLdTBPH/Erxzw==',key_name='tempest-keypair-286024332',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:32:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40918dc1308241a78b063ebd3c655ab4',ramdisk_id='',reservation_id='r-bflev6ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-749852486',owner_user_name='tempest-ServerStableDeviceRescueTest-749852486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:34:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c80d8eb201914d10b31bb83b4a37b326',uuid=1a747a16-45b2-4d60-aad0-f8bfbc7b0c41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Converting VIF {"id": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "address": "fa:16:3e:d3:6c:07", "network": {"id": "763d2138-168e-4f11-823a-4167572838f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1392814095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40918dc1308241a78b063ebd3c655ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c519d-45", "ovs_interfaceid": "758c519d-4502-4a83-9900-5cdfbc22c4f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:6c:07,bridge_name='br-int',has_traffic_filtering=True,id=758c519d-4502-4a83-9900-5cdfbc22c4f3,network=Network(763d2138-168e-4f11-823a-4167572838f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c519d-45') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG os_vif [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:6c:07,bridge_name='br-int',has_traffic_filtering=True,id=758c519d-4502-4a83-9900-5cdfbc22c4f3,network=Network(763d2138-168e-4f11-823a-4167572838f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c519d-45') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap758c519d-45, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:41 user nova-compute[72818]: INFO os_vif [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:6c:07,bridge_name='br-int',has_traffic_filtering=True,id=758c519d-4502-4a83-9900-5cdfbc22c4f3,network=Network(763d2138-168e-4f11-823a-4167572838f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c519d-45')
Aug 17 21:35:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Deleting instance files /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41_del
Aug 17 21:35:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Deletion of /opt/stack/data/nova/instances/1a747a16-45b2-4d60-aad0-f8bfbc7b0c41_del complete
Aug 17 21:35:41 user nova-compute[72818]: INFO nova.compute.manager [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 21:35:41 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:35:41 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:35:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:42 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:35:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-b275e29b-6170-4d47-bca6-062ffe5dd0c7 req-6a0f7e2d-a95b-4d97-97de-7f8604663518 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-deleted-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:42 user nova-compute[72818]: INFO nova.compute.manager [req-b275e29b-6170-4d47-bca6-062ffe5dd0c7 req-6a0f7e2d-a95b-4d97-97de-7f8604663518 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Neutron deleted interface 758c519d-4502-4a83-9900-5cdfbc22c4f3; detaching it from the instance and deleting it from the info cache
Aug 17 21:35:42 user nova-compute[72818]: DEBUG nova.network.neutron [req-b275e29b-6170-4d47-bca6-062ffe5dd0c7 req-6a0f7e2d-a95b-4d97-97de-7f8604663518 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:35:42 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Took 0.94 seconds to deallocate network for instance.
Aug 17 21:35:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-b275e29b-6170-4d47-bca6-062ffe5dd0c7 req-6a0f7e2d-a95b-4d97-97de-7f8604663518 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Detach interface failed, port_id=758c519d-4502-4a83-9900-5cdfbc22c4f3, reason: Instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:35:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:43 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:35:43 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:35:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:43 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Deleted allocations for instance 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41
Aug 17 21:35:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-51955a78-4b4b-4503-9258-71ccd6343ac2 tempest-ServerStableDeviceRescueTest-749852486 tempest-ServerStableDeviceRescueTest-749852486-project-member] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.453s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-0b66c99f-9ab5-42ac-8ef0-35c665877208 req-22ad00af-b53f-488c-aa7e-cc0e41bf37a1 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0b66c99f-9ab5-42ac-8ef0-35c665877208 req-22ad00af-b53f-488c-aa7e-cc0e41bf37a1 service nova] Acquiring lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0b66c99f-9ab5-42ac-8ef0-35c665877208 req-22ad00af-b53f-488c-aa7e-cc0e41bf37a1 service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0b66c99f-9ab5-42ac-8ef0-35c665877208 req-22ad00af-b53f-488c-aa7e-cc0e41bf37a1 service nova] Lock "1a747a16-45b2-4d60-aad0-f8bfbc7b0c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-0b66c99f-9ab5-42ac-8ef0-35c665877208 req-22ad00af-b53f-488c-aa7e-cc0e41bf37a1 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] No waiting events found dispatching network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:43 user nova-compute[72818]: WARNING nova.compute.manager [req-0b66c99f-9ab5-42ac-8ef0-35c665877208 req-22ad00af-b53f-488c-aa7e-cc0e41bf37a1 service nova] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Received unexpected event network-vif-plugged-758c519d-4502-4a83-9900-5cdfbc22c4f3 for instance with vm_state deleted and task_state None.
Aug 17 21:35:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:48 user nova-compute[72818]: INFO nova.compute.manager [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Terminating instance
Aug 17 21:35:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-fd4dfd66-4c4c-4b7b-b360-66b9bc71aec9 req-676b99d1-64c8-43ba-9580-c3bc6cf65b34 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-unplugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fd4dfd66-4c4c-4b7b-b360-66b9bc71aec9 req-676b99d1-64c8-43ba-9580-c3bc6cf65b34 service nova] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fd4dfd66-4c4c-4b7b-b360-66b9bc71aec9 req-676b99d1-64c8-43ba-9580-c3bc6cf65b34 service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fd4dfd66-4c4c-4b7b-b360-66b9bc71aec9 req-676b99d1-64c8-43ba-9580-c3bc6cf65b34 service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-fd4dfd66-4c4c-4b7b-b360-66b9bc71aec9 req-676b99d1-64c8-43ba-9580-c3bc6cf65b34 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] No waiting events found dispatching network-vif-unplugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-fd4dfd66-4c4c-4b7b-b360-66b9bc71aec9 req-676b99d1-64c8-43ba-9580-c3bc6cf65b34 service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-unplugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:48 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Instance destroyed successfully.
Aug 17 21:35:48 user nova-compute[72818]: DEBUG nova.objects.instance [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'resources' on Instance uuid 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-141122876',display_name='tempest-ServerRescueNegativeTestJSON-server-141122876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-141122876',id=16,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:21:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f6bdddb43364e86b302c9c2e273fd44',ramdisk_id='',reservation_id='r-maezm2id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-713886303',owner_user_name='tempest-ServerRescueNegativeTestJSON-713886303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:21:20Z,user_data=None,user_id='8ffa40080d9842b1a4f6a3e041b5d123',uuid=94abd430-6fc8-4c31-9dc8-c44df16ed4a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converting VIF {"id": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "address": "fa:16:3e:ed:bf:34", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37ec1f4-f3", "ovs_interfaceid": "c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:bf:34,bridge_name='br-int',has_traffic_filtering=True,id=c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37ec1f4-f3') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG os_vif [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:bf:34,bridge_name='br-int',has_traffic_filtering=True,id=c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37ec1f4-f3') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc37ec1f4-f3, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:48 user nova-compute[72818]: INFO os_vif [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:bf:34,bridge_name='br-int',has_traffic_filtering=True,id=c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37ec1f4-f3')
Aug 17 21:35:48 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Deleting instance files /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3_del
Aug 17 21:35:48 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Deletion of /opt/stack/data/nova/instances/94abd430-6fc8-4c31-9dc8-c44df16ed4a3_del complete
Aug 17 21:35:48 user nova-compute[72818]: INFO nova.compute.manager [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 17 21:35:48 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:35:48 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:35:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:49 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:35:49 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Took 0.94 seconds to deallocate network for instance.
Aug 17 21:35:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:50 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Deleted allocations for instance 94abd430-6fc8-4c31-9dc8-c44df16ed4a3
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-024cdcdf-c28a-43ca-8e96-b05c68a40726 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.283s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] No waiting events found dispatching network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:50 user nova-compute[72818]: WARNING nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received unexpected event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 for instance with vm_state deleted and task_state None.
Aug 17 21:35:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] No waiting events found dispatching network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:50 user nova-compute[72818]: WARNING nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received unexpected event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 for instance with vm_state deleted and task_state None.
Aug 17 21:35:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] No waiting events found dispatching network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:50 user nova-compute[72818]: WARNING nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received unexpected event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 for instance with vm_state deleted and task_state None.
Aug 17 21:35:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] Acquiring lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] Lock "94abd430-6fc8-4c31-9dc8-c44df16ed4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] No waiting events found dispatching network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:50 user nova-compute[72818]: WARNING nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received unexpected event network-vif-plugged-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 for instance with vm_state deleted and task_state None.
Aug 17 21:35:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-74c7800d-2289-4d34-b9c4-16b0bd93ea00 req-7714b3b7-30bc-4fb3-bbc8-cc491929ea8b service nova] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Received event network-vif-deleted-c37ec1f4-f31f-46b8-a9f0-2c6d4134a6f5 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.objects.instance [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquired lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.objects.instance [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'info_cache' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Updating instance_info_cache with network_info: [{"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Releasing lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:35:52 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance destroyed successfully.
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.objects.instance [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'resources' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1630001746',display_name='tempest-AttachVolumeTestJSON-server-1630001746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1630001746',id=29,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUZBvBBpmxnbCIWpS4jBvvAKyP0bQz/vTtdwsd7hEqD4r8z1NOmBaGEjW/K67Sh9o5eiqiRV1WPAPKHJZxGhSDnnIJOt7TtiEiP50gowTOal29LQ0rCa9uTNGAxeT0cnw==',key_name='tempest-keypair-392288452',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d6482e624bb9417598bb26fa0622641d',ramdisk_id='',reservation_id='r-snuu5rli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1086990444',owner_user_name='tempest-AttachVolumeTestJSON-1086990444-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:34:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10aff1c23f1041c485ab50735d2dcc12',uuid=e322a0ce-e887-4e29-a5c4-a0da74db3c7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converting VIF {"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG os_vif [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a8f5ce4-c8, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:52 user nova-compute[72818]: INFO os_vif [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8')
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Start _get_guest_xml network_info=[{"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.objects.instance [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'numa_topology' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:52 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:35:52 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.objects.instance [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'vcpu_model' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1630001746',display_name='tempest-AttachVolumeTestJSON-server-1630001746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1630001746',id=29,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUZBvBBpmxnbCIWpS4jBvvAKyP0bQz/vTtdwsd7hEqD4r8z1NOmBaGEjW/K67Sh9o5eiqiRV1WPAPKHJZxGhSDnnIJOt7TtiEiP50gowTOal29LQ0rCa9uTNGAxeT0cnw==',key_name='tempest-keypair-392288452',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d6482e624bb9417598bb26fa0622641d',ramdisk_id='',reservation_id='r-snuu5rli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1086990444',owner_user_name='tempest-AttachVolumeTestJSON-1086990444-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:34:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10aff1c23f1041c485ab50735d2dcc12',uuid=e322a0ce-e887-4e29-a5c4-a0da74db3c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converting VIF {"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.objects.instance [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'pci_devices' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:35:52 user nova-compute[72818]:   <uuid>e322a0ce-e887-4e29-a5c4-a0da74db3c7f</uuid>
Aug 17 21:35:52 user nova-compute[72818]:   <name>instance-0000001d</name>
Aug 17 21:35:52 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:35:52 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:35:52 user nova-compute[72818]:   <metadata>
Aug 17 21:35:52 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:35:52 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:35:52 user nova-compute[72818]:       <nova:name>tempest-AttachVolumeTestJSON-server-1630001746</nova:name>
Aug 17 21:35:52 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:35:52</nova:creationTime>
Aug 17 21:35:52 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:35:52 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:35:52 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:35:52 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:35:52 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:35:52 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:35:52 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:35:52 user nova-compute[72818]:       <nova:owner>
Aug 17 21:35:52 user nova-compute[72818]:         <nova:user uuid="10aff1c23f1041c485ab50735d2dcc12">tempest-AttachVolumeTestJSON-1086990444-project-member</nova:user>
Aug 17 21:35:52 user nova-compute[72818]:         <nova:project uuid="d6482e624bb9417598bb26fa0622641d">tempest-AttachVolumeTestJSON-1086990444</nova:project>
Aug 17 21:35:52 user nova-compute[72818]:       </nova:owner>
Aug 17 21:35:52 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:35:52 user nova-compute[72818]:       <nova:ports>
Aug 17 21:35:52 user nova-compute[72818]:         <nova:port uuid="5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d">
Aug 17 21:35:52 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 21:35:52 user nova-compute[72818]:         </nova:port>
Aug 17 21:35:52 user nova-compute[72818]:       </nova:ports>
Aug 17 21:35:52 user nova-compute[72818]:     </nova:instance>
Aug 17 21:35:52 user nova-compute[72818]:   </metadata>
Aug 17 21:35:52 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:35:52 user nova-compute[72818]:     <system>
Aug 17 21:35:52 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:35:52 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:35:52 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:35:52 user nova-compute[72818]:       <entry name="serial">e322a0ce-e887-4e29-a5c4-a0da74db3c7f</entry>
Aug 17 21:35:52 user nova-compute[72818]:       <entry name="uuid">e322a0ce-e887-4e29-a5c4-a0da74db3c7f</entry>
Aug 17 21:35:52 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:35:52 user nova-compute[72818]:     </system>
Aug 17 21:35:52 user nova-compute[72818]:   </sysinfo>
Aug 17 21:35:52 user nova-compute[72818]:   <os>
Aug 17 21:35:52 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:35:52 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:35:52 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:35:52 user nova-compute[72818]:   </os>
Aug 17 21:35:52 user nova-compute[72818]:   <features>
Aug 17 21:35:52 user nova-compute[72818]:     <acpi/>
Aug 17 21:35:52 user nova-compute[72818]:     <apic/>
Aug 17 21:35:52 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:35:52 user nova-compute[72818]:   </features>
Aug 17 21:35:52 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:35:52 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:35:52 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:35:52 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:35:52 user nova-compute[72818]:   </clock>
Aug 17 21:35:52 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:35:52 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:35:52 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:35:52 user nova-compute[72818]:   </cpu>
Aug 17 21:35:52 user nova-compute[72818]:   <devices>
Aug 17 21:35:52 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:35:52 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:35:52 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk"/>
Aug 17 21:35:52 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:35:52 user nova-compute[72818]:     </disk>
Aug 17 21:35:52 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:35:52 user nova-compute[72818]:       <mac address="fa:16:3e:dc:c2:13"/>
Aug 17 21:35:52 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:35:52 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:35:52 user nova-compute[72818]:       <target dev="tap5a8f5ce4-c8"/>
Aug 17 21:35:52 user nova-compute[72818]:     </interface>
Aug 17 21:35:52 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:35:52 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/console.log" append="off"/>
Aug 17 21:35:52 user nova-compute[72818]:     </serial>
Aug 17 21:35:52 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:35:52 user nova-compute[72818]:     <video>
Aug 17 21:35:52 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:35:52 user nova-compute[72818]:     </video>
Aug 17 21:35:52 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:35:52 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:35:52 user nova-compute[72818]:     </rng>
Aug 17 21:35:52 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:35:52 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:35:52 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:35:52 user nova-compute[72818]:     </memballoon>
Aug 17 21:35:52 user nova-compute[72818]:   </devices>
Aug 17 21:35:52 user nova-compute[72818]: </domain>
Aug 17 21:35:52 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:35:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG nova.objects.instance [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'trusted_certs' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Cannot resize image /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG nova.objects.instance [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'migration_context' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1630001746',display_name='tempest-AttachVolumeTestJSON-server-1630001746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1630001746',id=29,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUZBvBBpmxnbCIWpS4jBvvAKyP0bQz/vTtdwsd7hEqD4r8z1NOmBaGEjW/K67Sh9o5eiqiRV1WPAPKHJZxGhSDnnIJOt7TtiEiP50gowTOal29LQ0rCa9uTNGAxeT0cnw==',key_name='tempest-keypair-392288452',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d6482e624bb9417598bb26fa0622641d',ramdisk_id='',reservation_id='r-snuu5rli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1086990444',owner_user_name='tempest-AttachVolumeTestJSON-1086990444-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:34:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10aff1c23f1041c485ab50735d2dcc12',uuid=e322a0ce-e887-4e29-a5c4-a0da74db3c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converting VIF {"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG os_vif [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a8f5ce4-c8, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a8f5ce4-c8, col_values=(('external_ids', {'iface-id': '5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:c2:13', 'vm-uuid': 'e322a0ce-e887-4e29-a5c4-a0da74db3c7f'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:35:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:53 user nova-compute[72818]: INFO os_vif [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8')
Aug 17 21:35:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-f120b5b7-709b-43aa-a167-b255686e14f7 req-f01a630d-5385-4a8c-bc1d-005d79f8fb00 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f120b5b7-709b-43aa-a167-b255686e14f7 req-f01a630d-5385-4a8c-bc1d-005d79f8fb00 service nova] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f120b5b7-709b-43aa-a167-b255686e14f7 req-f01a630d-5385-4a8c-bc1d-005d79f8fb00 service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f120b5b7-709b-43aa-a167-b255686e14f7 req-f01a630d-5385-4a8c-bc1d-005d79f8fb00 service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-f120b5b7-709b-43aa-a167-b255686e14f7 req-f01a630d-5385-4a8c-bc1d-005d79f8fb00 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] No waiting events found dispatching network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:55 user nova-compute[72818]: WARNING nova.compute.manager [req-f120b5b7-709b-43aa-a167-b255686e14f7 req-f01a630d-5385-4a8c-bc1d-005d79f8fb00 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received unexpected event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d for instance with vm_state stopped and task_state powering-on.
Aug 17 21:35:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:56 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308141.7969437, 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:35:56 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] VM Stopped (Lifecycle Event)
Aug 17 21:35:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c1f32200-059f-460c-b25d-25c812e5a12b None None] [instance: 1a747a16-45b2-4d60-aad0-f8bfbc7b0c41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:35:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:35:57 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308157.4481697, e322a0ce-e887-4e29-a5c4-a0da74db3c7f => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:35:57 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] VM Resumed (Lifecycle Event)
Aug 17 21:35:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:35:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance rebooted successfully.
Aug 17 21:35:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-117bdbd3-8931-4012-87d5-230385fb3e25 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:35:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:35:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:35:57 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 21:35:57 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308157.4518988, e322a0ce-e887-4e29-a5c4-a0da74db3c7f => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:35:57 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] VM Started (Lifecycle Event)
Aug 17 21:35:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:35:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:35:57 user nova-compute[72818]: DEBUG nova.compute.manager [req-4b1ad90b-7531-4826-b74d-a1d8f0b58b82 req-b687b702-b15b-4c04-94c0-3a859ceeeb10 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:35:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4b1ad90b-7531-4826-b74d-a1d8f0b58b82 req-b687b702-b15b-4c04-94c0-3a859ceeeb10 service nova] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:35:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4b1ad90b-7531-4826-b74d-a1d8f0b58b82 req-b687b702-b15b-4c04-94c0-3a859ceeeb10 service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:35:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4b1ad90b-7531-4826-b74d-a1d8f0b58b82 req-b687b702-b15b-4c04-94c0-3a859ceeeb10 service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:35:57 user nova-compute[72818]: DEBUG nova.compute.manager [req-4b1ad90b-7531-4826-b74d-a1d8f0b58b82 req-b687b702-b15b-4c04-94c0-3a859ceeeb10 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] No waiting events found dispatching network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:35:57 user nova-compute[72818]: WARNING nova.compute.manager [req-4b1ad90b-7531-4826-b74d-a1d8f0b58b82 req-b687b702-b15b-4c04-94c0-3a859ceeeb10 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received unexpected event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d for instance with vm_state active and task_state None.
Aug 17 21:35:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:36:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:04 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308148.813463, 94abd430-6fc8-4c31-9dc8-c44df16ed4a3 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:36:04 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] VM Stopped (Lifecycle Event)
Aug 17 21:36:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-64766e0d-7651-49dd-a085-802875857940 None None] [instance: 94abd430-6fc8-4c31-9dc8-c44df16ed4a3] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:36:05 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:36:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:36:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:36:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:07 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:36:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:36:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 21:36:07 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:36:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72818) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 21:36:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:08 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:36:09 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:36:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:36:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:36:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:36:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:36:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:36:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8120MB free_disk=25.40475082397461GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:36:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 4b43de5d-62c1-4368-8a77-59899ae0b16d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 284e9f53-7677-4f21-b998-759f1d151f9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing inventories for resource provider d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating ProviderTree inventory for provider d156e3af-684d-47e1-a951-585f9c95fa46 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing aggregate associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, aggregates: None {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing trait associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] There are 1 instances to clean {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Instance has had 1 of 5 cleanup attempts {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11142}}
Aug 17 21:36:13 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Deleting instance files /opt/stack/data/nova/instances/2e4ea99b-4bfd-4c21-9824-ffa3ad63164a_del
Aug 17 21:36:13 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 2e4ea99b-4bfd-4c21-9824-ffa3ad63164a] Deletion of /opt/stack/data/nova/instances/2e4ea99b-4bfd-4c21-9824-ffa3ad63164a_del complete
Aug 17 21:36:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:36:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "aee17e23-ac55-4c71-bd40-a9315b1294ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:36:15 user nova-compute[72818]: INFO nova.compute.claims [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Claim successful on node user
Aug 17 21:36:15 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG nova.network.neutron [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:36:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:36:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:36:15 user nova-compute[72818]: INFO nova.virt.block_device [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Booting with volume 68a9d689-8136-4eca-8e34-4125f727c3e1 at /dev/vda
Aug 17 21:36:15 user nova-compute[72818]: DEBUG nova.policy [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de902559a8794d1a8af9c0efbed4e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92abc22a192a44398dffe75ffae6d270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG os_brick.utils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[726d1f3d-8873-4419-885a-8a3752d55e7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd1ab76-5f60-40e2-b359-106668a5c360]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c99abf1-c535-4a26-877c-99d1e2164809]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1690904d-faf6-40b6-91f2-b1a4adf1ecbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:36:16 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:36:16 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b11b68-9030-4f2d-9bdc-0269e33db9d3]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG os_brick.utils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Updating existing volume attachment record: 0e9f252f-1af4-49ed-a0e0-bc016d342433 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:36:16 user nova-compute[72818]: DEBUG nova.network.neutron [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Successfully created port: 4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Successfully updated port: 4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "refresh_cache-aee17e23-ac55-4c71-bd40-a9315b1294ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquired lock "refresh_cache-aee17e23-ac55-4c71-bd40-a9315b1294ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-a7067d8c-bffe-4906-8dbc-fbedce21a355 req-2b881aa6-8b48-42e6-9d15-965b748e3de0 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Received event network-changed-4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG nova.compute.manager [req-a7067d8c-bffe-4906-8dbc-fbedce21a355 req-2b881aa6-8b48-42e6-9d15-965b748e3de0 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Refreshing instance network info cache due to event network-changed-4874c588-3034-4936-bed2-a61d132e3a45. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7067d8c-bffe-4906-8dbc-fbedce21a355 req-2b881aa6-8b48-42e6-9d15-965b748e3de0 service nova] Acquiring lock "refresh_cache-aee17e23-ac55-4c71-bd40-a9315b1294ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Updating instance_info_cache with network_info: [{"id": "4874c588-3034-4936-bed2-a61d132e3a45", "address": "fa:16:3e:b0:ae:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4874c588-30", "ovs_interfaceid": "4874c588-3034-4936-bed2-a61d132e3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Releasing lock "refresh_cache-aee17e23-ac55-4c71-bd40-a9315b1294ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Instance network_info: |[{"id": "4874c588-3034-4936-bed2-a61d132e3a45", "address": "fa:16:3e:b0:ae:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4874c588-30", "ovs_interfaceid": "4874c588-3034-4936-bed2-a61d132e3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7067d8c-bffe-4906-8dbc-fbedce21a355 req-2b881aa6-8b48-42e6-9d15-965b748e3de0 service nova] Acquired lock "refresh_cache-aee17e23-ac55-4c71-bd40-a9315b1294ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:36:17 user nova-compute[72818]: DEBUG nova.network.neutron [req-a7067d8c-bffe-4906-8dbc-fbedce21a355 req-2b881aa6-8b48-42e6-9d15-965b748e3de0 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Refreshing network info cache for port 4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:36:18 user nova-compute[72818]: DEBUG nova.network.neutron [req-a7067d8c-bffe-4906-8dbc-fbedce21a355 req-2b881aa6-8b48-42e6-9d15-965b748e3de0 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Updated VIF entry in instance network info cache for port 4874c588-3034-4936-bed2-a61d132e3a45. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:36:18 user nova-compute[72818]: DEBUG nova.network.neutron [req-a7067d8c-bffe-4906-8dbc-fbedce21a355 req-2b881aa6-8b48-42e6-9d15-965b748e3de0 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Updating instance_info_cache with network_info: [{"id": "4874c588-3034-4936-bed2-a61d132e3a45", "address": "fa:16:3e:b0:ae:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4874c588-30", "ovs_interfaceid": "4874c588-3034-4936-bed2-a61d132e3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:36:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a7067d8c-bffe-4906-8dbc-fbedce21a355 req-2b881aa6-8b48-42e6-9d15-965b748e3de0 service nova] Releasing lock "refresh_cache-aee17e23-ac55-4c71-bd40-a9315b1294ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:36:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:36:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Creating image(s)
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Ensure instance console log exists: /opt/stack/data/nova/instances/aee17e23-ac55-4c71-bd40-a9315b1294ac/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Start _get_guest_xml network_info=[{"id": "4874c588-3034-4936-bed2-a61d132e3a45", "address": "fa:16:3e:b0:ae:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4874c588-30", "ovs_interfaceid": "4874c588-3034-4936-bed2-a61d132e3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '0e9f252f-1af4-49ed-a0e0-bc016d342433', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBJncWFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aee17e23-ac55-4c71-bd40-a9315b1294ac', 'attached_at': '', 'detached_at': '', 'volume_id': '68a9d689-8136-4eca-8e34-4125f727c3e1', 'serial': '68a9d689-8136-4eca-8e34-4125f727c3e1'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:36:28 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:36:28 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBJncWFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:36:28 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:36:28 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:36:28 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff1cee7-c300-4f7c-81a8-5f11fd3b71fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:36:28 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[354af8de-2e5d-4917-8293-4472582bac59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1] added
Aug 17 21:36:28 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[486af1dc-bcd2-4289-96ef-efe1cd666bda]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd411990-f2a8-42a3-90a8-798ad7bfc0c5]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBJncWFa {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBJncWFa" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[409756ae-7c3d-4748-bf4b-fd2a8e113206]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBJncWFa'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2062cd16-69dc-48c2-b112-24893139ea39]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a5f491-1a45-454b-b51a-423af41ef857]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9c9efb-fe5c-4f55-b8e6-46442bb6cf43 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1cadf3-9318-4e3f-a2ad-5b1e32ee1b6c (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9c9efb-fe5c-4f55-b8e6-46442bb6cf43 (non-flash)
Aug 17 21:36:28 user nova-compute[72818]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1cadf3-9318-4e3f-a2ad-5b1e32ee1b6c (non-flash)
Aug 17 21:36:28 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9c9efb-fe5c-4f55-b8e6-46442bb6cf43 (non-flash)
Aug 17 21:36:28 user nova-compute[72818]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1cadf3-9318-4e3f-a2ad-5b1e32ee1b6c (non-flash)
Aug 17 21:36:28 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[372cd193-e452-4c7c-8722-f2138a5835a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260]
Aug 17 21:36:28 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260] successful.
Aug 17 21:36:28 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf8b0e5-fc0b-4f42-8236-440786164c95]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb40b7c-672d-4988-b5b5-d8957a43f044]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9c9efb-fe5c-4f55-b8e6-46442bb6cf43 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1cadf3-9318-4e3f-a2ad-5b1e32ee1b6c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9c9efb-fe5c-4f55-b8e6-46442bb6cf43 (non-flash)
Aug 17 21:36:28 user nova-compute[72818]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1cadf3-9318-4e3f-a2ad-5b1e32ee1b6c (non-flash)
Aug 17 21:36:28 user nova-compute[72818]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:36:28 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9c9efb-fe5c-4f55-b8e6-46442bb6cf43 (non-flash)
Aug 17 21:36:28 user nova-compute[72818]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1cadf3-9318-4e3f-a2ad-5b1e32ee1b6c (non-flash)
Aug 17 21:36:28 user nova-compute[72818]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:36:28 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d242b-fcf8-4a9b-a197-bba1f281da8b]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:36:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBJncWFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23861313266643065', 'path': '/dev/sdd'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861313266643065', 'path': '/dev/sdd'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:36:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-474651830',display_name='tempest-TestVolumeBootPattern-server-474651830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-474651830',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvgvYY4VEzOO1hBWsb20sNrMVs8w/XTYHCJEm0Bvp0JOphCdpXxCT+2Vc1RBvadH4gKZoKMMxsPeL8omuqOhZEcjdNF9Xh2fVwAM7u4vOVW7jR4hyrsil3xbR7zmO8kpg==',key_name='tempest-TestVolumeBootPattern-782174029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-s9ti1bcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:36:16Z,user_data=None,user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=aee17e23-ac55-4c71-bd40-a9315b1294ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4874c588-3034-4936-bed2-a61d132e3a45", "address": "fa:16:3e:b0:ae:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4874c588-30", "ovs_interfaceid": "4874c588-3034-4936-bed2-a61d132e3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "4874c588-3034-4936-bed2-a61d132e3a45", "address": "fa:16:3e:b0:ae:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4874c588-30", "ovs_interfaceid": "4874c588-3034-4936-bed2-a61d132e3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ae:da,bridge_name='br-int',has_traffic_filtering=True,id=4874c588-3034-4936-bed2-a61d132e3a45,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4874c588-30') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG nova.objects.instance [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lazy-loading 'pci_devices' on Instance uuid aee17e23-ac55-4c71-bd40-a9315b1294ac {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:36:29 user nova-compute[72818]:   <uuid>aee17e23-ac55-4c71-bd40-a9315b1294ac</uuid>
Aug 17 21:36:29 user nova-compute[72818]:   <name>instance-00000024</name>
Aug 17 21:36:29 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:36:29 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:36:29 user nova-compute[72818]:   <metadata>
Aug 17 21:36:29 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:36:29 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:36:29 user nova-compute[72818]:       <nova:name>tempest-TestVolumeBootPattern-server-474651830</nova:name>
Aug 17 21:36:29 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:36:28</nova:creationTime>
Aug 17 21:36:29 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:36:29 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:36:29 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:36:29 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:36:29 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:36:29 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:36:29 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:36:29 user nova-compute[72818]:       <nova:owner>
Aug 17 21:36:29 user nova-compute[72818]:         <nova:user uuid="de902559a8794d1a8af9c0efbed4e38a">tempest-TestVolumeBootPattern-973058317-project-member</nova:user>
Aug 17 21:36:29 user nova-compute[72818]:         <nova:project uuid="92abc22a192a44398dffe75ffae6d270">tempest-TestVolumeBootPattern-973058317</nova:project>
Aug 17 21:36:29 user nova-compute[72818]:       </nova:owner>
Aug 17 21:36:29 user nova-compute[72818]:       <nova:ports>
Aug 17 21:36:29 user nova-compute[72818]:         <nova:port uuid="4874c588-3034-4936-bed2-a61d132e3a45">
Aug 17 21:36:29 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 21:36:29 user nova-compute[72818]:         </nova:port>
Aug 17 21:36:29 user nova-compute[72818]:       </nova:ports>
Aug 17 21:36:29 user nova-compute[72818]:     </nova:instance>
Aug 17 21:36:29 user nova-compute[72818]:   </metadata>
Aug 17 21:36:29 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:36:29 user nova-compute[72818]:     <system>
Aug 17 21:36:29 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:36:29 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:36:29 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:36:29 user nova-compute[72818]:       <entry name="serial">aee17e23-ac55-4c71-bd40-a9315b1294ac</entry>
Aug 17 21:36:29 user nova-compute[72818]:       <entry name="uuid">aee17e23-ac55-4c71-bd40-a9315b1294ac</entry>
Aug 17 21:36:29 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:36:29 user nova-compute[72818]:     </system>
Aug 17 21:36:29 user nova-compute[72818]:   </sysinfo>
Aug 17 21:36:29 user nova-compute[72818]:   <os>
Aug 17 21:36:29 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:36:29 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:36:29 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:36:29 user nova-compute[72818]:   </os>
Aug 17 21:36:29 user nova-compute[72818]:   <features>
Aug 17 21:36:29 user nova-compute[72818]:     <acpi/>
Aug 17 21:36:29 user nova-compute[72818]:     <apic/>
Aug 17 21:36:29 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:36:29 user nova-compute[72818]:   </features>
Aug 17 21:36:29 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:36:29 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:36:29 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:36:29 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:36:29 user nova-compute[72818]:   </clock>
Aug 17 21:36:29 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:36:29 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:36:29 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:36:29 user nova-compute[72818]:   </cpu>
Aug 17 21:36:29 user nova-compute[72818]:   <devices>
Aug 17 21:36:29 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:36:29 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:36:29 user nova-compute[72818]:       <source dev="/dev/sdd"/>
Aug 17 21:36:29 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:36:29 user nova-compute[72818]:       <serial>68a9d689-8136-4eca-8e34-4125f727c3e1</serial>
Aug 17 21:36:29 user nova-compute[72818]:     </disk>
Aug 17 21:36:29 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:36:29 user nova-compute[72818]:       <mac address="fa:16:3e:b0:ae:da"/>
Aug 17 21:36:29 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:36:29 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:36:29 user nova-compute[72818]:       <target dev="tap4874c588-30"/>
Aug 17 21:36:29 user nova-compute[72818]:     </interface>
Aug 17 21:36:29 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:36:29 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/aee17e23-ac55-4c71-bd40-a9315b1294ac/console.log" append="off"/>
Aug 17 21:36:29 user nova-compute[72818]:     </serial>
Aug 17 21:36:29 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:36:29 user nova-compute[72818]:     <video>
Aug 17 21:36:29 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:36:29 user nova-compute[72818]:     </video>
Aug 17 21:36:29 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:36:29 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:36:29 user nova-compute[72818]:     </rng>
Aug 17 21:36:29 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:36:29 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:36:29 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:36:29 user nova-compute[72818]:     </memballoon>
Aug 17 21:36:29 user nova-compute[72818]:   </devices>
Aug 17 21:36:29 user nova-compute[72818]: </domain>
Aug 17 21:36:29 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:36:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-474651830',display_name='tempest-TestVolumeBootPattern-server-474651830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-474651830',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvgvYY4VEzOO1hBWsb20sNrMVs8w/XTYHCJEm0Bvp0JOphCdpXxCT+2Vc1RBvadH4gKZoKMMxsPeL8omuqOhZEcjdNF9Xh2fVwAM7u4vOVW7jR4hyrsil3xbR7zmO8kpg==',key_name='tempest-TestVolumeBootPattern-782174029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-s9ti1bcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:36:16Z,user_data=None,user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=aee17e23-ac55-4c71-bd40-a9315b1294ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4874c588-3034-4936-bed2-a61d132e3a45", "address": "fa:16:3e:b0:ae:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4874c588-30", "ovs_interfaceid": "4874c588-3034-4936-bed2-a61d132e3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "4874c588-3034-4936-bed2-a61d132e3a45", "address": "fa:16:3e:b0:ae:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4874c588-30", "ovs_interfaceid": "4874c588-3034-4936-bed2-a61d132e3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ae:da,bridge_name='br-int',has_traffic_filtering=True,id=4874c588-3034-4936-bed2-a61d132e3a45,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4874c588-30') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG os_vif [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ae:da,bridge_name='br-int',has_traffic_filtering=True,id=4874c588-3034-4936-bed2-a61d132e3a45,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4874c588-30') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4874c588-30, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4874c588-30, col_values=(('external_ids', {'iface-id': '4874c588-3034-4936-bed2-a61d132e3a45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:ae:da', 'vm-uuid': 'aee17e23-ac55-4c71-bd40-a9315b1294ac'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:29 user nova-compute[72818]: INFO os_vif [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ae:da,bridge_name='br-int',has_traffic_filtering=True,id=4874c588-3034-4936-bed2-a61d132e3a45,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4874c588-30')
Aug 17 21:36:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:36:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] No VIF found with MAC fa:16:3e:b0:ae:da, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:36:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-290618e6-a1dc-408a-bb87-0c5ade12b83d req-61ed3d2c-c2b7-46c4-a576-7af884377af3 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Received event network-vif-plugged-4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:36:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-290618e6-a1dc-408a-bb87-0c5ade12b83d req-61ed3d2c-c2b7-46c4-a576-7af884377af3 service nova] Acquiring lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-290618e6-a1dc-408a-bb87-0c5ade12b83d req-61ed3d2c-c2b7-46c4-a576-7af884377af3 service nova] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-290618e6-a1dc-408a-bb87-0c5ade12b83d req-61ed3d2c-c2b7-46c4-a576-7af884377af3 service nova] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-290618e6-a1dc-408a-bb87-0c5ade12b83d req-61ed3d2c-c2b7-46c4-a576-7af884377af3 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] No waiting events found dispatching network-vif-plugged-4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:36:31 user nova-compute[72818]: WARNING nova.compute.manager [req-290618e6-a1dc-408a-bb87-0c5ade12b83d req-61ed3d2c-c2b7-46c4-a576-7af884377af3 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Received unexpected event network-vif-plugged-4874c588-3034-4936-bed2-a61d132e3a45 for instance with vm_state building and task_state spawning.
Aug 17 21:36:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308192.9296813, aee17e23-ac55-4c71-bd40-a9315b1294ac => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:36:32 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] VM Resumed (Lifecycle Event)
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:36:32 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Instance spawned successfully.
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:36:32 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:36:32 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308192.9315565, aee17e23-ac55-4c71-bd40-a9315b1294ac => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:36:32 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] VM Started (Lifecycle Event)
Aug 17 21:36:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:36:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:36:33 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:36:33 user nova-compute[72818]: INFO nova.compute.manager [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Took 5.02 seconds to spawn the instance on the hypervisor.
Aug 17 21:36:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:36:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-772ff8cf-000f-434d-aef4-46b7210ec001 req-f68cb875-80fe-48d1-aad0-794220eb5e1a service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Received event network-vif-plugged-4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:36:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-772ff8cf-000f-434d-aef4-46b7210ec001 req-f68cb875-80fe-48d1-aad0-794220eb5e1a service nova] Acquiring lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-772ff8cf-000f-434d-aef4-46b7210ec001 req-f68cb875-80fe-48d1-aad0-794220eb5e1a service nova] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-772ff8cf-000f-434d-aef4-46b7210ec001 req-f68cb875-80fe-48d1-aad0-794220eb5e1a service nova] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-772ff8cf-000f-434d-aef4-46b7210ec001 req-f68cb875-80fe-48d1-aad0-794220eb5e1a service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] No waiting events found dispatching network-vif-plugged-4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:36:33 user nova-compute[72818]: WARNING nova.compute.manager [req-772ff8cf-000f-434d-aef4-46b7210ec001 req-f68cb875-80fe-48d1-aad0-794220eb5e1a service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Received unexpected event network-vif-plugged-4874c588-3034-4936-bed2-a61d132e3a45 for instance with vm_state building and task_state spawning.
Aug 17 21:36:33 user nova-compute[72818]: INFO nova.compute.manager [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Took 17.78 seconds to build instance.
Aug 17 21:36:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-943eae6a-292f-46d4-98eb-6f942f70ff1c tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.916s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:36 user nova-compute[72818]: INFO nova.compute.manager [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Terminating instance
Aug 17 21:36:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:36:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-ce50602f-21dc-4e3c-aa1b-5f5adffd1219 req-6e2d3fd9-f5d8-4505-8aa3-facbeea151a4 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Received event network-vif-unplugged-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ce50602f-21dc-4e3c-aa1b-5f5adffd1219 req-6e2d3fd9-f5d8-4505-8aa3-facbeea151a4 service nova] Acquiring lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ce50602f-21dc-4e3c-aa1b-5f5adffd1219 req-6e2d3fd9-f5d8-4505-8aa3-facbeea151a4 service nova] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ce50602f-21dc-4e3c-aa1b-5f5adffd1219 req-6e2d3fd9-f5d8-4505-8aa3-facbeea151a4 service nova] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-ce50602f-21dc-4e3c-aa1b-5f5adffd1219 req-6e2d3fd9-f5d8-4505-8aa3-facbeea151a4 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] No waiting events found dispatching network-vif-unplugged-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-ce50602f-21dc-4e3c-aa1b-5f5adffd1219 req-6e2d3fd9-f5d8-4505-8aa3-facbeea151a4 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Received event network-vif-unplugged-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:36:37 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Instance destroyed successfully.
Aug 17 21:36:37 user nova-compute[72818]: DEBUG nova.objects.instance [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lazy-loading 'resources' on Instance uuid ac704cc9-16b1-4bf5-830a-f1ca33c97c6a {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1201093147',display_name='tempest-ServerActionsTestOtherA-server-1201093147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1201093147',id=17,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV/yxdZf0gbz0Oc0hEv4WwXP2jV20fy0LitgWYnfEN52KHQjmeuLO48ZiCuSailjRm1wHuszXDlB837Vche8MvGzjfdhLQW/IYo033/9mpCOWKkYkF4Ly8lZgNbXJbUlw==',key_name='tempest-keypair-570023473',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5202a87dcf64b979cce5074783790f9',ramdisk_id='',reservation_id='r-h4pgw0dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1230434837',owner_user_name='tempest-ServerActionsTestOtherA-1230434837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb8a969924487b8362d340d0bd31b5',uuid=ac704cc9-16b1-4bf5-830a-f1ca33c97c6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converting VIF {"id": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "address": "fa:16:3e:b7:13:3e", "network": {"id": "54b19db6-e7a3-4c72-9dbc-edf0d944a754", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1787003302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5202a87dcf64b979cce5074783790f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48bf93f-29", "ovs_interfaceid": "c48bf93f-2922-454f-a8ac-f8a92d7b0b6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:13:3e,bridge_name='br-int',has_traffic_filtering=True,id=c48bf93f-2922-454f-a8ac-f8a92d7b0b6a,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48bf93f-29') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG os_vif [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:13:3e,bridge_name='br-int',has_traffic_filtering=True,id=c48bf93f-2922-454f-a8ac-f8a92d7b0b6a,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48bf93f-29') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc48bf93f-29, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:36:37 user nova-compute[72818]: INFO os_vif [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:13:3e,bridge_name='br-int',has_traffic_filtering=True,id=c48bf93f-2922-454f-a8ac-f8a92d7b0b6a,network=Network(54b19db6-e7a3-4c72-9dbc-edf0d944a754),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48bf93f-29')
Aug 17 21:36:37 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Deleting instance files /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a_del
Aug 17 21:36:37 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Deletion of /opt/stack/data/nova/instances/ac704cc9-16b1-4bf5-830a-f1ca33c97c6a_del complete
Aug 17 21:36:37 user nova-compute[72818]: INFO nova.compute.manager [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 21:36:37 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:36:37 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:36:38 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Took 0.59 seconds to deallocate network for instance.
Aug 17 21:36:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-372359bc-063c-4b5d-856d-160eabe5d083 req-fa28812c-114d-435c-aa11-e71df9a2f902 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Received event network-vif-deleted-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:36:38 user nova-compute[72818]: INFO nova.compute.manager [req-372359bc-063c-4b5d-856d-160eabe5d083 req-fa28812c-114d-435c-aa11-e71df9a2f902 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Neutron deleted interface c48bf93f-2922-454f-a8ac-f8a92d7b0b6a; detaching it from the instance and deleting it from the info cache
Aug 17 21:36:38 user nova-compute[72818]: DEBUG nova.network.neutron [req-372359bc-063c-4b5d-856d-160eabe5d083 req-fa28812c-114d-435c-aa11-e71df9a2f902 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-372359bc-063c-4b5d-856d-160eabe5d083 req-fa28812c-114d-435c-aa11-e71df9a2f902 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Detach interface failed, port_id=c48bf93f-2922-454f-a8ac-f8a92d7b0b6a, reason: Instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:38 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Deleted allocations for instance ac704cc9-16b1-4bf5-830a-f1ca33c97c6a
Aug 17 21:36:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:38 user nova-compute[72818]: INFO nova.compute.manager [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Terminating instance
Aug 17 21:36:38 user nova-compute[72818]: DEBUG nova.compute.manager [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-744ce90f-8c9d-4719-a1c4-3e5685030e8c tempest-ServerActionsTestOtherA-1230434837 tempest-ServerActionsTestOtherA-1230434837-project-member] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.934s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:39 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Instance destroyed successfully.
Aug 17 21:36:39 user nova-compute[72818]: DEBUG nova.objects.instance [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lazy-loading 'resources' on Instance uuid 4b43de5d-62c1-4368-8a77-59899ae0b16d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-688622221',display_name='tempest-ServerRescueNegativeTestJSON-server-688622221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-688622221',id=15,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f6bdddb43364e86b302c9c2e273fd44',ramdisk_id='',reservation_id='r-ek70jhb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-713886303',owner_user_name='tempest-ServerRescueNegativeTestJSON-713886303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:26:07Z,user_data=None,user_id='8ffa40080d9842b1a4f6a3e041b5d123',uuid=4b43de5d-62c1-4368-8a77-59899ae0b16d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converting VIF {"id": "73bea181-5987-4935-af5c-9f87b135d933", "address": "fa:16:3e:de:61:a7", "network": {"id": "b46b1ecf-6f08-450d-be6c-b4178704f813", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1288214149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f6bdddb43364e86b302c9c2e273fd44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bea181-59", "ovs_interfaceid": "73bea181-5987-4935-af5c-9f87b135d933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:61:a7,bridge_name='br-int',has_traffic_filtering=True,id=73bea181-5987-4935-af5c-9f87b135d933,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bea181-59') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG os_vif [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:61:a7,bridge_name='br-int',has_traffic_filtering=True,id=73bea181-5987-4935-af5c-9f87b135d933,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bea181-59') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73bea181-59, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:36:39 user nova-compute[72818]: INFO os_vif [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:61:a7,bridge_name='br-int',has_traffic_filtering=True,id=73bea181-5987-4935-af5c-9f87b135d933,network=Network(b46b1ecf-6f08-450d-be6c-b4178704f813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bea181-59')
Aug 17 21:36:39 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Deleting instance files /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d_del
Aug 17 21:36:39 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Deletion of /opt/stack/data/nova/instances/4b43de5d-62c1-4368-8a77-59899ae0b16d_del complete
Aug 17 21:36:39 user nova-compute[72818]: INFO nova.compute.manager [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 17 21:36:39 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG nova.compute.manager [req-f23900ed-2571-46a5-b62c-e534c0c35bd1 req-a55e980c-497a-4c3a-a667-419660961291 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Received event network-vif-plugged-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f23900ed-2571-46a5-b62c-e534c0c35bd1 req-a55e980c-497a-4c3a-a667-419660961291 service nova] Acquiring lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f23900ed-2571-46a5-b62c-e534c0c35bd1 req-a55e980c-497a-4c3a-a667-419660961291 service nova] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f23900ed-2571-46a5-b62c-e534c0c35bd1 req-a55e980c-497a-4c3a-a667-419660961291 service nova] Lock "ac704cc9-16b1-4bf5-830a-f1ca33c97c6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:39 user nova-compute[72818]: DEBUG nova.compute.manager [req-f23900ed-2571-46a5-b62c-e534c0c35bd1 req-a55e980c-497a-4c3a-a667-419660961291 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] No waiting events found dispatching network-vif-plugged-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:36:39 user nova-compute[72818]: WARNING nova.compute.manager [req-f23900ed-2571-46a5-b62c-e534c0c35bd1 req-a55e980c-497a-4c3a-a667-419660961291 service nova] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Received unexpected event network-vif-plugged-c48bf93f-2922-454f-a8ac-f8a92d7b0b6a for instance with vm_state deleted and task_state None.
Aug 17 21:36:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-ac82adbd-1f5f-4c6d-b7e7-53d7b3d98c9a req-898f85ea-1e9b-4de3-9fef-4540a221b34b service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-unplugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ac82adbd-1f5f-4c6d-b7e7-53d7b3d98c9a req-898f85ea-1e9b-4de3-9fef-4540a221b34b service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ac82adbd-1f5f-4c6d-b7e7-53d7b3d98c9a req-898f85ea-1e9b-4de3-9fef-4540a221b34b service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ac82adbd-1f5f-4c6d-b7e7-53d7b3d98c9a req-898f85ea-1e9b-4de3-9fef-4540a221b34b service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-ac82adbd-1f5f-4c6d-b7e7-53d7b3d98c9a req-898f85ea-1e9b-4de3-9fef-4540a221b34b service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-unplugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-ac82adbd-1f5f-4c6d-b7e7-53d7b3d98c9a req-898f85ea-1e9b-4de3-9fef-4540a221b34b service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-unplugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-ac82adbd-1f5f-4c6d-b7e7-53d7b3d98c9a req-898f85ea-1e9b-4de3-9fef-4540a221b34b service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ac82adbd-1f5f-4c6d-b7e7-53d7b3d98c9a req-898f85ea-1e9b-4de3-9fef-4540a221b34b service nova] Acquiring lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ac82adbd-1f5f-4c6d-b7e7-53d7b3d98c9a req-898f85ea-1e9b-4de3-9fef-4540a221b34b service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ac82adbd-1f5f-4c6d-b7e7-53d7b3d98c9a req-898f85ea-1e9b-4de3-9fef-4540a221b34b service nova] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-ac82adbd-1f5f-4c6d-b7e7-53d7b3d98c9a req-898f85ea-1e9b-4de3-9fef-4540a221b34b service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] No waiting events found dispatching network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:36:40 user nova-compute[72818]: WARNING nova.compute.manager [req-ac82adbd-1f5f-4c6d-b7e7-53d7b3d98c9a req-898f85ea-1e9b-4de3-9fef-4540a221b34b service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received unexpected event network-vif-plugged-73bea181-5987-4935-af5c-9f87b135d933 for instance with vm_state active and task_state deleting.
Aug 17 21:36:40 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:36:40 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Took 0.87 seconds to deallocate network for instance.
Aug 17 21:36:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:36:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:40 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Deleted allocations for instance 4b43de5d-62c1-4368-8a77-59899ae0b16d
Aug 17 21:36:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-23443d53-831d-4341-85cb-324c8b99c462 tempest-ServerRescueNegativeTestJSON-713886303 tempest-ServerRescueNegativeTestJSON-713886303-project-member] Lock "4b43de5d-62c1-4368-8a77-59899ae0b16d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.373s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-e246d673-c4de-4ef4-a092-17a316ebdc4d req-4bb49f75-1306-4e0b-878b-45cccd35fc85 service nova] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Received event network-vif-deleted-73bea181-5987-4935-af5c-9f87b135d933 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:36:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:36:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:52 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308197.4348657, ac704cc9-16b1-4bf5-830a-f1ca33c97c6a => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:36:52 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] VM Stopped (Lifecycle Event)
Aug 17 21:36:52 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d1710252-4d82-4fb6-bcc5-8cac971dcaf3 None None] [instance: ac704cc9-16b1-4bf5-830a-f1ca33c97c6a] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:36:54 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308199.3312602, 4b43de5d-62c1-4368-8a77-59899ae0b16d => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:36:54 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] VM Stopped (Lifecycle Event)
Aug 17 21:36:54 user nova-compute[72818]: DEBUG nova.compute.manager [None req-7c51f668-4df9-46b8-a2bf-aee0d7f3c631 None None] [instance: 4b43de5d-62c1-4368-8a77-59899ae0b16d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:36:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Acquiring lock "56e732de-965f-4d74-a9ca-ed75631e6f02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:36:58 user nova-compute[72818]: INFO nova.compute.claims [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Claim successful on node user
Aug 17 21:36:58 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG nova.network.neutron [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:36:58 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:36:58 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG nova.policy [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e6d89bf123d4d4caa506e1ba2bcecd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb70e73ae48d43bead27304e7050b27c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:36:58 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Creating image(s)
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Acquiring lock "/opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "/opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "/opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk 1073741824" returned: 0 in 0.048s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG nova.network.neutron [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Successfully created port: 254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Cannot resize image /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG nova.objects.instance [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lazy-loading 'migration_context' on Instance uuid 56e732de-965f-4d74-a9ca-ed75631e6f02 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Ensure instance console log exists: /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:36:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Successfully updated port: 254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Acquiring lock "refresh_cache-56e732de-965f-4d74-a9ca-ed75631e6f02" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Acquired lock "refresh_cache-56e732de-965f-4d74-a9ca-ed75631e6f02" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.compute.manager [req-ede02c67-a692-4a59-a59f-35ec758c81f0 req-a04c3aa8-514b-46b9-99d4-cb9006ed7f30 service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Received event network-changed-254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.compute.manager [req-ede02c67-a692-4a59-a59f-35ec758c81f0 req-a04c3aa8-514b-46b9-99d4-cb9006ed7f30 service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Refreshing instance network info cache due to event network-changed-254ce475-7668-4974-a621-10315c2ceca7. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ede02c67-a692-4a59-a59f-35ec758c81f0 req-a04c3aa8-514b-46b9-99d4-cb9006ed7f30 service nova] Acquiring lock "refresh_cache-56e732de-965f-4d74-a9ca-ed75631e6f02" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Updating instance_info_cache with network_info: [{"id": "254ce475-7668-4974-a621-10315c2ceca7", "address": "fa:16:3e:8c:04:26", "network": {"id": "6c11edcd-d873-4311-82c5-0847ce1c9abf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6438a8b236d74a9585300eb2b1ce044f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ce475-76", "ovs_interfaceid": "254ce475-7668-4974-a621-10315c2ceca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Releasing lock "refresh_cache-56e732de-965f-4d74-a9ca-ed75631e6f02" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Instance network_info: |[{"id": "254ce475-7668-4974-a621-10315c2ceca7", "address": "fa:16:3e:8c:04:26", "network": {"id": "6c11edcd-d873-4311-82c5-0847ce1c9abf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6438a8b236d74a9585300eb2b1ce044f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ce475-76", "ovs_interfaceid": "254ce475-7668-4974-a621-10315c2ceca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ede02c67-a692-4a59-a59f-35ec758c81f0 req-a04c3aa8-514b-46b9-99d4-cb9006ed7f30 service nova] Acquired lock "refresh_cache-56e732de-965f-4d74-a9ca-ed75631e6f02" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.network.neutron [req-ede02c67-a692-4a59-a59f-35ec758c81f0 req-a04c3aa8-514b-46b9-99d4-cb9006ed7f30 service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Refreshing network info cache for port 254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Start _get_guest_xml network_info=[{"id": "254ce475-7668-4974-a621-10315c2ceca7", "address": "fa:16:3e:8c:04:26", "network": {"id": "6c11edcd-d873-4311-82c5-0847ce1c9abf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6438a8b236d74a9585300eb2b1ce044f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ce475-76", "ovs_interfaceid": "254ce475-7668-4974-a621-10315c2ceca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:37:00 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:37:00 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-395309725',display_name='tempest-VolumesNegativeTest-instance-395309725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-395309725',id=37,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb70e73ae48d43bead27304e7050b27c',ramdisk_id='',reservation_id='r-ojayof8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1719328213',owner_user_name='tempest-VolumesNegativeTest-1719328213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:36:59Z,user_data=None,user_id='8e6d89bf123d4d4caa506e1ba2bcecd5',uuid=56e732de-965f-4d74-a9ca-ed75631e6f02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254ce475-7668-4974-a621-10315c2ceca7", "address": "fa:16:3e:8c:04:26", "network": {"id": "6c11edcd-d873-4311-82c5-0847ce1c9abf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6438a8b236d74a9585300eb2b1ce044f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ce475-76", "ovs_interfaceid": "254ce475-7668-4974-a621-10315c2ceca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Converting VIF {"id": "254ce475-7668-4974-a621-10315c2ceca7", "address": "fa:16:3e:8c:04:26", "network": {"id": "6c11edcd-d873-4311-82c5-0847ce1c9abf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6438a8b236d74a9585300eb2b1ce044f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ce475-76", "ovs_interfaceid": "254ce475-7668-4974-a621-10315c2ceca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:04:26,bridge_name='br-int',has_traffic_filtering=True,id=254ce475-7668-4974-a621-10315c2ceca7,network=Network(6c11edcd-d873-4311-82c5-0847ce1c9abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ce475-76') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.objects.instance [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lazy-loading 'pci_devices' on Instance uuid 56e732de-965f-4d74-a9ca-ed75631e6f02 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:37:00 user nova-compute[72818]:   <uuid>56e732de-965f-4d74-a9ca-ed75631e6f02</uuid>
Aug 17 21:37:00 user nova-compute[72818]:   <name>instance-00000025</name>
Aug 17 21:37:00 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:37:00 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:37:00 user nova-compute[72818]:   <metadata>
Aug 17 21:37:00 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:37:00 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:37:00 user nova-compute[72818]:       <nova:name>tempest-VolumesNegativeTest-instance-395309725</nova:name>
Aug 17 21:37:00 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:37:00</nova:creationTime>
Aug 17 21:37:00 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:37:00 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:37:00 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:37:00 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:37:00 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:37:00 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:37:00 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:37:00 user nova-compute[72818]:       <nova:owner>
Aug 17 21:37:00 user nova-compute[72818]:         <nova:user uuid="8e6d89bf123d4d4caa506e1ba2bcecd5">tempest-VolumesNegativeTest-1719328213-project-member</nova:user>
Aug 17 21:37:00 user nova-compute[72818]:         <nova:project uuid="bb70e73ae48d43bead27304e7050b27c">tempest-VolumesNegativeTest-1719328213</nova:project>
Aug 17 21:37:00 user nova-compute[72818]:       </nova:owner>
Aug 17 21:37:00 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:37:00 user nova-compute[72818]:       <nova:ports>
Aug 17 21:37:00 user nova-compute[72818]:         <nova:port uuid="254ce475-7668-4974-a621-10315c2ceca7">
Aug 17 21:37:00 user nova-compute[72818]:           <nova:ip type="fixed" address="192.168.233.118" ipVersion="4"/>
Aug 17 21:37:00 user nova-compute[72818]:         </nova:port>
Aug 17 21:37:00 user nova-compute[72818]:       </nova:ports>
Aug 17 21:37:00 user nova-compute[72818]:     </nova:instance>
Aug 17 21:37:00 user nova-compute[72818]:   </metadata>
Aug 17 21:37:00 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:37:00 user nova-compute[72818]:     <system>
Aug 17 21:37:00 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:37:00 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:37:00 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:37:00 user nova-compute[72818]:       <entry name="serial">56e732de-965f-4d74-a9ca-ed75631e6f02</entry>
Aug 17 21:37:00 user nova-compute[72818]:       <entry name="uuid">56e732de-965f-4d74-a9ca-ed75631e6f02</entry>
Aug 17 21:37:00 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:37:00 user nova-compute[72818]:     </system>
Aug 17 21:37:00 user nova-compute[72818]:   </sysinfo>
Aug 17 21:37:00 user nova-compute[72818]:   <os>
Aug 17 21:37:00 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:37:00 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:37:00 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:37:00 user nova-compute[72818]:   </os>
Aug 17 21:37:00 user nova-compute[72818]:   <features>
Aug 17 21:37:00 user nova-compute[72818]:     <acpi/>
Aug 17 21:37:00 user nova-compute[72818]:     <apic/>
Aug 17 21:37:00 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:37:00 user nova-compute[72818]:   </features>
Aug 17 21:37:00 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:37:00 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:37:00 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:37:00 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:37:00 user nova-compute[72818]:   </clock>
Aug 17 21:37:00 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:37:00 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:37:00 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:37:00 user nova-compute[72818]:   </cpu>
Aug 17 21:37:00 user nova-compute[72818]:   <devices>
Aug 17 21:37:00 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:37:00 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:37:00 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk"/>
Aug 17 21:37:00 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:37:00 user nova-compute[72818]:     </disk>
Aug 17 21:37:00 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:37:00 user nova-compute[72818]:       <mac address="fa:16:3e:8c:04:26"/>
Aug 17 21:37:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:37:00 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:37:00 user nova-compute[72818]:       <target dev="tap254ce475-76"/>
Aug 17 21:37:00 user nova-compute[72818]:     </interface>
Aug 17 21:37:00 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:37:00 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/console.log" append="off"/>
Aug 17 21:37:00 user nova-compute[72818]:     </serial>
Aug 17 21:37:00 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:37:00 user nova-compute[72818]:     <video>
Aug 17 21:37:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:37:00 user nova-compute[72818]:     </video>
Aug 17 21:37:00 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:37:00 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:37:00 user nova-compute[72818]:     </rng>
Aug 17 21:37:00 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:37:00 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:37:00 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:37:00 user nova-compute[72818]:     </memballoon>
Aug 17 21:37:00 user nova-compute[72818]:   </devices>
Aug 17 21:37:00 user nova-compute[72818]: </domain>
Aug 17 21:37:00 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-395309725',display_name='tempest-VolumesNegativeTest-instance-395309725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-395309725',id=37,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb70e73ae48d43bead27304e7050b27c',ramdisk_id='',reservation_id='r-ojayof8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1719328213',owner_user_name='tempest-VolumesNegativeTest-1719328213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:36:59Z,user_data=None,user_id='8e6d89bf123d4d4caa506e1ba2bcecd5',uuid=56e732de-965f-4d74-a9ca-ed75631e6f02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254ce475-7668-4974-a621-10315c2ceca7", "address": "fa:16:3e:8c:04:26", "network": {"id": "6c11edcd-d873-4311-82c5-0847ce1c9abf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6438a8b236d74a9585300eb2b1ce044f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ce475-76", "ovs_interfaceid": "254ce475-7668-4974-a621-10315c2ceca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Converting VIF {"id": "254ce475-7668-4974-a621-10315c2ceca7", "address": "fa:16:3e:8c:04:26", "network": {"id": "6c11edcd-d873-4311-82c5-0847ce1c9abf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6438a8b236d74a9585300eb2b1ce044f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ce475-76", "ovs_interfaceid": "254ce475-7668-4974-a621-10315c2ceca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:04:26,bridge_name='br-int',has_traffic_filtering=True,id=254ce475-7668-4974-a621-10315c2ceca7,network=Network(6c11edcd-d873-4311-82c5-0847ce1c9abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ce475-76') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG os_vif [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:04:26,bridge_name='br-int',has_traffic_filtering=True,id=254ce475-7668-4974-a621-10315c2ceca7,network=Network(6c11edcd-d873-4311-82c5-0847ce1c9abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ce475-76') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap254ce475-76, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap254ce475-76, col_values=(('external_ids', {'iface-id': '254ce475-7668-4974-a621-10315c2ceca7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:04:26', 'vm-uuid': '56e732de-965f-4d74-a9ca-ed75631e6f02'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:00 user nova-compute[72818]: INFO os_vif [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:04:26,bridge_name='br-int',has_traffic_filtering=True,id=254ce475-7668-4974-a621-10315c2ceca7,network=Network(6c11edcd-d873-4311-82c5-0847ce1c9abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ce475-76')
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] No VIF found with MAC fa:16:3e:8c:04:26, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.network.neutron [req-ede02c67-a692-4a59-a59f-35ec758c81f0 req-a04c3aa8-514b-46b9-99d4-cb9006ed7f30 service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Updated VIF entry in instance network info cache for port 254ce475-7668-4974-a621-10315c2ceca7. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG nova.network.neutron [req-ede02c67-a692-4a59-a59f-35ec758c81f0 req-a04c3aa8-514b-46b9-99d4-cb9006ed7f30 service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Updating instance_info_cache with network_info: [{"id": "254ce475-7668-4974-a621-10315c2ceca7", "address": "fa:16:3e:8c:04:26", "network": {"id": "6c11edcd-d873-4311-82c5-0847ce1c9abf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6438a8b236d74a9585300eb2b1ce044f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ce475-76", "ovs_interfaceid": "254ce475-7668-4974-a621-10315c2ceca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:37:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ede02c67-a692-4a59-a59f-35ec758c81f0 req-a04c3aa8-514b-46b9-99d4-cb9006ed7f30 service nova] Releasing lock "refresh_cache-56e732de-965f-4d74-a9ca-ed75631e6f02" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:37:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-c50154d1-2c28-4bd3-b7e8-47e07c59f10e req-67b7c9f1-0492-462a-a903-e5616215133b service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Received event network-vif-plugged-254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c50154d1-2c28-4bd3-b7e8-47e07c59f10e req-67b7c9f1-0492-462a-a903-e5616215133b service nova] Acquiring lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c50154d1-2c28-4bd3-b7e8-47e07c59f10e req-67b7c9f1-0492-462a-a903-e5616215133b service nova] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c50154d1-2c28-4bd3-b7e8-47e07c59f10e req-67b7c9f1-0492-462a-a903-e5616215133b service nova] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-c50154d1-2c28-4bd3-b7e8-47e07c59f10e req-67b7c9f1-0492-462a-a903-e5616215133b service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] No waiting events found dispatching network-vif-plugged-254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:37:02 user nova-compute[72818]: WARNING nova.compute.manager [req-c50154d1-2c28-4bd3-b7e8-47e07c59f10e req-67b7c9f1-0492-462a-a903-e5616215133b service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Received unexpected event network-vif-plugged-254ce475-7668-4974-a621-10315c2ceca7 for instance with vm_state building and task_state spawning.
Aug 17 21:37:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308224.22646, 56e732de-965f-4d74-a9ca-ed75631e6f02 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:37:04 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] VM Resumed (Lifecycle Event)
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:37:04 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Instance spawned successfully.
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:37:04 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308224.2315376, 56e732de-965f-4d74-a9ca-ed75631e6f02 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:37:04 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] VM Started (Lifecycle Event)
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:37:04 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-773faeac-620c-49ce-9dce-c0c319fd1c9e req-9a5998ff-0929-44a5-8fb8-316a6405b7f4 service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Received event network-vif-plugged-254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-773faeac-620c-49ce-9dce-c0c319fd1c9e req-9a5998ff-0929-44a5-8fb8-316a6405b7f4 service nova] Acquiring lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-773faeac-620c-49ce-9dce-c0c319fd1c9e req-9a5998ff-0929-44a5-8fb8-316a6405b7f4 service nova] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-773faeac-620c-49ce-9dce-c0c319fd1c9e req-9a5998ff-0929-44a5-8fb8-316a6405b7f4 service nova] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-773faeac-620c-49ce-9dce-c0c319fd1c9e req-9a5998ff-0929-44a5-8fb8-316a6405b7f4 service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] No waiting events found dispatching network-vif-plugged-254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:37:04 user nova-compute[72818]: WARNING nova.compute.manager [req-773faeac-620c-49ce-9dce-c0c319fd1c9e req-9a5998ff-0929-44a5-8fb8-316a6405b7f4 service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Received unexpected event network-vif-plugged-254ce475-7668-4974-a621-10315c2ceca7 for instance with vm_state building and task_state spawning.
Aug 17 21:37:04 user nova-compute[72818]: INFO nova.compute.manager [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 17 21:37:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:37:04 user nova-compute[72818]: INFO nova.compute.manager [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Took 6.20 seconds to build instance.
Aug 17 21:37:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-34cbe3b9-19e9-4aa6-a769-c0a1e533aebc tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.295s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:37:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:37:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:07 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:37:07 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:37:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:37:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:37:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:37:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:37:07 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:37:07 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:37:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Updating instance_info_cache with network_info: [{"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:37:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-e322a0ce-e887-4e29-a5c4-a0da74db3c7f" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:37:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:37:09 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:37:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:37:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:37:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:37:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:37:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:37:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:37:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:37:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:37:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:37:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:37:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:37:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:37:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:37:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:37:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:37:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:37:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:37:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:37:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:37:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8128MB free_disk=25.44776153564453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:37:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:37:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 284e9f53-7677-4f21-b998-759f1d151f9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:37:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance aee17e23-ac55-4c71-bd40-a9315b1294ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:37:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 56e732de-965f-4d74-a9ca-ed75631e6f02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:37:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:37:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:37:12 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:37:12 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:37:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:37:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:37:15 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:37:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:22 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:37:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-31691ed6-49e1-4edc-a927-c8face133fbe req-8ddaf885-2af8-49d0-a84e-42ce478c04ec service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-changed-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-31691ed6-49e1-4edc-a927-c8face133fbe req-8ddaf885-2af8-49d0-a84e-42ce478c04ec service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Refreshing instance network info cache due to event network-changed-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:37:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-31691ed6-49e1-4edc-a927-c8face133fbe req-8ddaf885-2af8-49d0-a84e-42ce478c04ec service nova] Acquiring lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:37:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-31691ed6-49e1-4edc-a927-c8face133fbe req-8ddaf885-2af8-49d0-a84e-42ce478c04ec service nova] Acquired lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:37:24 user nova-compute[72818]: DEBUG nova.network.neutron [req-31691ed6-49e1-4edc-a927-c8face133fbe req-8ddaf885-2af8-49d0-a84e-42ce478c04ec service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Refreshing network info cache for port 5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:37:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-31691ed6-49e1-4edc-a927-c8face133fbe req-8ddaf885-2af8-49d0-a84e-42ce478c04ec service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updated VIF entry in instance network info cache for port 5b51c2ed-5dd4-461f-9c75-0ef59e66b00f. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:37:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-31691ed6-49e1-4edc-a927-c8face133fbe req-8ddaf885-2af8-49d0-a84e-42ce478c04ec service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updating instance_info_cache with network_info: [{"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:37:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-31691ed6-49e1-4edc-a927-c8face133fbe req-8ddaf885-2af8-49d0-a84e-42ce478c04ec service nova] Releasing lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:37:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "284e9f53-7677-4f21-b998-759f1d151f9d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:29 user nova-compute[72818]: INFO nova.compute.manager [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Shelving
Aug 17 21:37:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:29 user nova-compute[72818]: DEBUG nova.compute.manager [req-dbaa2f4b-57a2-43fb-bf1a-a1dc4e4e6bc3 req-bb6ab27f-a4c9-4101-95a5-8340da3bcccc service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-vif-unplugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-dbaa2f4b-57a2-43fb-bf1a-a1dc4e4e6bc3 req-bb6ab27f-a4c9-4101-95a5-8340da3bcccc service nova] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-dbaa2f4b-57a2-43fb-bf1a-a1dc4e4e6bc3 req-bb6ab27f-a4c9-4101-95a5-8340da3bcccc service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-dbaa2f4b-57a2-43fb-bf1a-a1dc4e4e6bc3 req-bb6ab27f-a4c9-4101-95a5-8340da3bcccc service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:29 user nova-compute[72818]: DEBUG nova.compute.manager [req-dbaa2f4b-57a2-43fb-bf1a-a1dc4e4e6bc3 req-bb6ab27f-a4c9-4101-95a5-8340da3bcccc service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] No waiting events found dispatching network-vif-unplugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:37:29 user nova-compute[72818]: WARNING nova.compute.manager [req-dbaa2f4b-57a2-43fb-bf1a-a1dc4e4e6bc3 req-bb6ab27f-a4c9-4101-95a5-8340da3bcccc service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received unexpected event network-vif-unplugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f for instance with vm_state active and task_state shelving.
Aug 17 21:37:29 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Instance destroyed successfully.
Aug 17 21:37:30 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Beginning cold snapshot process
Aug 17 21:37:30 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:37:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk /opt/stack/data/nova/instances/snapshots/tmpexoyogbj/2e8015fe58144871a5aa2dc9c95bae4a {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:37:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk /opt/stack/data/nova/instances/snapshots/tmpexoyogbj/2e8015fe58144871a5aa2dc9c95bae4a" returned: 0 in 0.545s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:37:30 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Snapshot extracted, beginning image upload
Aug 17 21:37:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-e6c45816-d802-4de5-a2be-938725b9dcab req-d926fe2f-4549-40d5-b840-601e55998cb6 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e6c45816-d802-4de5-a2be-938725b9dcab req-d926fe2f-4549-40d5-b840-601e55998cb6 service nova] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e6c45816-d802-4de5-a2be-938725b9dcab req-d926fe2f-4549-40d5-b840-601e55998cb6 service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e6c45816-d802-4de5-a2be-938725b9dcab req-d926fe2f-4549-40d5-b840-601e55998cb6 service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-e6c45816-d802-4de5-a2be-938725b9dcab req-d926fe2f-4549-40d5-b840-601e55998cb6 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] No waiting events found dispatching network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:37:31 user nova-compute[72818]: WARNING nova.compute.manager [req-e6c45816-d802-4de5-a2be-938725b9dcab req-d926fe2f-4549-40d5-b840-601e55998cb6 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received unexpected event network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 21:37:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Snapshot image upload complete
Aug 17 21:37:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:37:33 user nova-compute[72818]: INFO nova.compute.manager [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Shelve offloading
Aug 17 21:37:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Instance destroyed successfully.
Aug 17 21:37:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:37:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:37:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquired lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:37:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:37:33 user nova-compute[72818]: DEBUG nova.network.neutron [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updating instance_info_cache with network_info: [{"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:37:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Releasing lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:37:34 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Instance destroyed successfully.
Aug 17 21:37:34 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'resources' on Instance uuid 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1471917594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1471917594',id=35,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHo2Z6RZPRkdg03MXM22dNzinbjZ9356gsX/8BwOTg5F2VFak9gkLfvjkT7eCvd5roCAlsS1utAeXUkNyKMF86k+fZUWgs05GSc3LmYrb+1Yh4jeColgmVjndZWFXEZOg==',key_name='tempest-keypair-8619247',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:35:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4a9d9dc56ba84253be502280f64d7b59',ramdisk_id='',reservation_id='r-06vbaj3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-895220279',owner_user_name='tempest-AttachVolumeShelveTestJSON-895220279-project-member',shelved_at='2023-08-17T21:37:33.161785',shelved_host='user',shelved_image_id='53f30d44-34b8-4350-843f-482a0628bd34'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:37:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcc7e79679c4ebb915828988321acc8',uuid=284e9f53-7677-4f21-b998-759f1d151f9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converting VIF {"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG os_vif [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b51c2ed-5d, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-bd801f60-42f1-41bf-a7a6-62d59ae38c67 req-3be7980e-abff-452b-aa04-1fe91b2452d8 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-changed-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-bd801f60-42f1-41bf-a7a6-62d59ae38c67 req-3be7980e-abff-452b-aa04-1fe91b2452d8 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Refreshing instance network info cache due to event network-changed-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bd801f60-42f1-41bf-a7a6-62d59ae38c67 req-3be7980e-abff-452b-aa04-1fe91b2452d8 service nova] Acquiring lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bd801f60-42f1-41bf-a7a6-62d59ae38c67 req-3be7980e-abff-452b-aa04-1fe91b2452d8 service nova] Acquired lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG nova.network.neutron [req-bd801f60-42f1-41bf-a7a6-62d59ae38c67 req-3be7980e-abff-452b-aa04-1fe91b2452d8 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Refreshing network info cache for port 5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:37:34 user nova-compute[72818]: INFO os_vif [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d')
Aug 17 21:37:34 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Deleting instance files /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d_del
Aug 17 21:37:34 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Deletion of /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d_del complete
Aug 17 21:37:34 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Deleted allocations for instance 284e9f53-7677-4f21-b998-759f1d151f9d
Aug 17 21:37:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:34 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'numa_topology' on Instance uuid 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:37:35 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:37:35 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:37:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d1ab3d10-da03-46cc-9e74-06f4e31343a6 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "284e9f53-7677-4f21-b998-759f1d151f9d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.068s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-bd801f60-42f1-41bf-a7a6-62d59ae38c67 req-3be7980e-abff-452b-aa04-1fe91b2452d8 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updated VIF entry in instance network info cache for port 5b51c2ed-5dd4-461f-9c75-0ef59e66b00f. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:37:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-bd801f60-42f1-41bf-a7a6-62d59ae38c67 req-3be7980e-abff-452b-aa04-1fe91b2452d8 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updating instance_info_cache with network_info: [{"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:37:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bd801f60-42f1-41bf-a7a6-62d59ae38c67 req-3be7980e-abff-452b-aa04-1fe91b2452d8 service nova] Releasing lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:37:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:43 user nova-compute[72818]: INFO nova.compute.manager [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Terminating instance
Aug 17 21:37:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-651b5a14-65fc-40fa-af1b-c131818b473a req-3524e28c-58b6-4bf8-baf4-fccd9287d6f4 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-unplugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-651b5a14-65fc-40fa-af1b-c131818b473a req-3524e28c-58b6-4bf8-baf4-fccd9287d6f4 service nova] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-651b5a14-65fc-40fa-af1b-c131818b473a req-3524e28c-58b6-4bf8-baf4-fccd9287d6f4 service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-651b5a14-65fc-40fa-af1b-c131818b473a req-3524e28c-58b6-4bf8-baf4-fccd9287d6f4 service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-651b5a14-65fc-40fa-af1b-c131818b473a req-3524e28c-58b6-4bf8-baf4-fccd9287d6f4 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] No waiting events found dispatching network-vif-unplugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-651b5a14-65fc-40fa-af1b-c131818b473a req-3524e28c-58b6-4bf8-baf4-fccd9287d6f4 service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-unplugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "01162bf0-7e42-4926-95e3-a286827e16bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "01162bf0-7e42-4926-95e3-a286827e16bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:37:44 user nova-compute[72818]: INFO nova.compute.claims [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Claim successful on node user
Aug 17 21:37:44 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Instance destroyed successfully.
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.objects.instance [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'resources' on Instance uuid e322a0ce-e887-4e29-a5c4-a0da74db3c7f {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1630001746',display_name='tempest-AttachVolumeTestJSON-server-1630001746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1630001746',id=29,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUZBvBBpmxnbCIWpS4jBvvAKyP0bQz/vTtdwsd7hEqD4r8z1NOmBaGEjW/K67Sh9o5eiqiRV1WPAPKHJZxGhSDnnIJOt7TtiEiP50gowTOal29LQ0rCa9uTNGAxeT0cnw==',key_name='tempest-keypair-392288452',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6482e624bb9417598bb26fa0622641d',ramdisk_id='',reservation_id='r-snuu5rli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1086990444',owner_user_name='tempest-AttachVolumeTestJSON-1086990444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10aff1c23f1041c485ab50735d2dcc12',uuid=e322a0ce-e887-4e29-a5c4-a0da74db3c7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converting VIF {"id": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "address": "fa:16:3e:dc:c2:13", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a8f5ce4-c8", "ovs_interfaceid": "5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG os_vif [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a8f5ce4-c8, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:37:44 user nova-compute[72818]: INFO os_vif [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:c2:13,bridge_name='br-int',has_traffic_filtering=True,id=5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a8f5ce4-c8')
Aug 17 21:37:44 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Deleting instance files /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f_del
Aug 17 21:37:44 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Deletion of /opt/stack/data/nova/instances/e322a0ce-e887-4e29-a5c4-a0da74db3c7f_del complete
Aug 17 21:37:44 user nova-compute[72818]: INFO nova.compute.manager [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 21:37:44 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.network.neutron [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:37:44 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.policy [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d025fb1e3974f5d91a7086343bbe5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffd845455a84fbf9e1517ffe2af001c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.compute.manager [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:37:44 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Creating image(s)
Aug 17 21:37:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "/opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "/opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "/opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:37:44 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308249.9524558, 284e9f53-7677-4f21-b998-759f1d151f9d => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:37:44 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] VM Stopped (Lifecycle Event)
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-581b345f-42d6-4ea1-8ad1-1daaabf624e4 None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.194s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk 1073741824" returned: 0 in 0.050s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:37:45 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Took 0.94 seconds to deallocate network for instance.
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.188s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.network.neutron [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Successfully created port: f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Cannot resize image /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.objects.instance [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'migration_context' on Instance uuid 01162bf0-7e42-4926-95e3-a286827e16bf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Ensure instance console log exists: /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:45 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Deleted allocations for instance e322a0ce-e887-4e29-a5c4-a0da74db3c7f
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-52b75e55-c5d3-4584-84c0-40af14cd3c24 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.282s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-f92b33e7-543b-4c7a-9396-26cbc84b3618 req-3a70acaf-fe26-4a5a-aabf-877a02a1796c service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f92b33e7-543b-4c7a-9396-26cbc84b3618 req-3a70acaf-fe26-4a5a-aabf-877a02a1796c service nova] Acquiring lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f92b33e7-543b-4c7a-9396-26cbc84b3618 req-3a70acaf-fe26-4a5a-aabf-877a02a1796c service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f92b33e7-543b-4c7a-9396-26cbc84b3618 req-3a70acaf-fe26-4a5a-aabf-877a02a1796c service nova] Lock "e322a0ce-e887-4e29-a5c4-a0da74db3c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-f92b33e7-543b-4c7a-9396-26cbc84b3618 req-3a70acaf-fe26-4a5a-aabf-877a02a1796c service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] No waiting events found dispatching network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:37:45 user nova-compute[72818]: WARNING nova.compute.manager [req-f92b33e7-543b-4c7a-9396-26cbc84b3618 req-3a70acaf-fe26-4a5a-aabf-877a02a1796c service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received unexpected event network-vif-plugged-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d for instance with vm_state deleted and task_state None.
Aug 17 21:37:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-f92b33e7-543b-4c7a-9396-26cbc84b3618 req-3a70acaf-fe26-4a5a-aabf-877a02a1796c service nova] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Received event network-vif-deleted-5a8f5ce4-c8b0-410a-8b55-ea4f9f3e620d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.network.neutron [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Successfully updated port: f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquired lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.network.neutron [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.compute.manager [req-a3949775-ca2e-4388-a379-161da1c24c02 req-b194c50e-24fe-43bd-8d5a-d5a2b185615c service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Received event network-changed-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.compute.manager [req-a3949775-ca2e-4388-a379-161da1c24c02 req-b194c50e-24fe-43bd-8d5a-d5a2b185615c service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Refreshing instance network info cache due to event network-changed-f63bea4d-b5cf-4137-b058-4d3a0f0a2063. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a3949775-ca2e-4388-a379-161da1c24c02 req-b194c50e-24fe-43bd-8d5a-d5a2b185615c service nova] Acquiring lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.network.neutron [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.network.neutron [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Updating instance_info_cache with network_info: [{"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Releasing lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.compute.manager [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Instance network_info: |[{"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a3949775-ca2e-4388-a379-161da1c24c02 req-b194c50e-24fe-43bd-8d5a-d5a2b185615c service nova] Acquired lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.network.neutron [req-a3949775-ca2e-4388-a379-161da1c24c02 req-b194c50e-24fe-43bd-8d5a-d5a2b185615c service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Refreshing network info cache for port f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Start _get_guest_xml network_info=[{"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:37:46 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:37:46 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:37:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1995112111',display_name='tempest-AttachVolumeNegativeTest-server-1995112111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1995112111',id=38,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlOfLYIORyZKi9eUvA12dywHM7TNuuB+HKGN8+QSik2o1S0p5fMn8iDXNUEtdFZhECPGFFss3vQOxz1J2KAso/FsaI2Vb1rpd0oL0EY0ge3ILIOLGzbkUGGnZm/GrB6QA==',key_name='tempest-keypair-121627058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ffd845455a84fbf9e1517ffe2af001c',ramdisk_id='',reservation_id='r-kpfstmfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2048664550',owner_user_name='tempest-AttachVolumeNegativeTest-2048664550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d025fb1e3974f5d91a7086343bbe5e1',uuid=01162bf0-7e42-4926-95e3-a286827e16bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converting VIF {"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:27:7a,bridge_name='br-int',has_traffic_filtering=True,id=f63bea4d-b5cf-4137-b058-4d3a0f0a2063,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63bea4d-b5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.objects.instance [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'pci_devices' on Instance uuid 01162bf0-7e42-4926-95e3-a286827e16bf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:37:46 user nova-compute[72818]:   <uuid>01162bf0-7e42-4926-95e3-a286827e16bf</uuid>
Aug 17 21:37:46 user nova-compute[72818]:   <name>instance-00000026</name>
Aug 17 21:37:46 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:37:46 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:37:46 user nova-compute[72818]:   <metadata>
Aug 17 21:37:46 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:37:46 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:37:46 user nova-compute[72818]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1995112111</nova:name>
Aug 17 21:37:46 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:37:46</nova:creationTime>
Aug 17 21:37:46 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:37:46 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:37:46 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:37:46 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:37:46 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:37:46 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:37:46 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:37:46 user nova-compute[72818]:       <nova:owner>
Aug 17 21:37:46 user nova-compute[72818]:         <nova:user uuid="4d025fb1e3974f5d91a7086343bbe5e1">tempest-AttachVolumeNegativeTest-2048664550-project-member</nova:user>
Aug 17 21:37:46 user nova-compute[72818]:         <nova:project uuid="7ffd845455a84fbf9e1517ffe2af001c">tempest-AttachVolumeNegativeTest-2048664550</nova:project>
Aug 17 21:37:46 user nova-compute[72818]:       </nova:owner>
Aug 17 21:37:46 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:37:46 user nova-compute[72818]:       <nova:ports>
Aug 17 21:37:46 user nova-compute[72818]:         <nova:port uuid="f63bea4d-b5cf-4137-b058-4d3a0f0a2063">
Aug 17 21:37:46 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 21:37:46 user nova-compute[72818]:         </nova:port>
Aug 17 21:37:46 user nova-compute[72818]:       </nova:ports>
Aug 17 21:37:46 user nova-compute[72818]:     </nova:instance>
Aug 17 21:37:46 user nova-compute[72818]:   </metadata>
Aug 17 21:37:46 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:37:46 user nova-compute[72818]:     <system>
Aug 17 21:37:46 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:37:46 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:37:46 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:37:46 user nova-compute[72818]:       <entry name="serial">01162bf0-7e42-4926-95e3-a286827e16bf</entry>
Aug 17 21:37:46 user nova-compute[72818]:       <entry name="uuid">01162bf0-7e42-4926-95e3-a286827e16bf</entry>
Aug 17 21:37:46 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:37:46 user nova-compute[72818]:     </system>
Aug 17 21:37:46 user nova-compute[72818]:   </sysinfo>
Aug 17 21:37:46 user nova-compute[72818]:   <os>
Aug 17 21:37:46 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:37:46 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:37:46 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:37:46 user nova-compute[72818]:   </os>
Aug 17 21:37:46 user nova-compute[72818]:   <features>
Aug 17 21:37:46 user nova-compute[72818]:     <acpi/>
Aug 17 21:37:46 user nova-compute[72818]:     <apic/>
Aug 17 21:37:46 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:37:46 user nova-compute[72818]:   </features>
Aug 17 21:37:46 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:37:46 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:37:46 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:37:46 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:37:46 user nova-compute[72818]:   </clock>
Aug 17 21:37:46 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:37:46 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:37:46 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:37:46 user nova-compute[72818]:   </cpu>
Aug 17 21:37:46 user nova-compute[72818]:   <devices>
Aug 17 21:37:46 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:37:46 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:37:46 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk"/>
Aug 17 21:37:46 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:37:46 user nova-compute[72818]:     </disk>
Aug 17 21:37:46 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:37:46 user nova-compute[72818]:       <mac address="fa:16:3e:22:27:7a"/>
Aug 17 21:37:46 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:37:46 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:37:46 user nova-compute[72818]:       <target dev="tapf63bea4d-b5"/>
Aug 17 21:37:46 user nova-compute[72818]:     </interface>
Aug 17 21:37:46 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:37:46 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/console.log" append="off"/>
Aug 17 21:37:46 user nova-compute[72818]:     </serial>
Aug 17 21:37:46 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:37:46 user nova-compute[72818]:     <video>
Aug 17 21:37:46 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:37:46 user nova-compute[72818]:     </video>
Aug 17 21:37:46 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:37:46 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:37:46 user nova-compute[72818]:     </rng>
Aug 17 21:37:46 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:37:46 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:37:46 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:37:46 user nova-compute[72818]:     </memballoon>
Aug 17 21:37:46 user nova-compute[72818]:   </devices>
Aug 17 21:37:46 user nova-compute[72818]: </domain>
Aug 17 21:37:46 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:37:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1995112111',display_name='tempest-AttachVolumeNegativeTest-server-1995112111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1995112111',id=38,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlOfLYIORyZKi9eUvA12dywHM7TNuuB+HKGN8+QSik2o1S0p5fMn8iDXNUEtdFZhECPGFFss3vQOxz1J2KAso/FsaI2Vb1rpd0oL0EY0ge3ILIOLGzbkUGGnZm/GrB6QA==',key_name='tempest-keypair-121627058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ffd845455a84fbf9e1517ffe2af001c',ramdisk_id='',reservation_id='r-kpfstmfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2048664550',owner_user_name='tempest-AttachVolumeNegativeTest-2048664550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d025fb1e3974f5d91a7086343bbe5e1',uuid=01162bf0-7e42-4926-95e3-a286827e16bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converting VIF {"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:27:7a,bridge_name='br-int',has_traffic_filtering=True,id=f63bea4d-b5cf-4137-b058-4d3a0f0a2063,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63bea4d-b5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG os_vif [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:27:7a,bridge_name='br-int',has_traffic_filtering=True,id=f63bea4d-b5cf-4137-b058-4d3a0f0a2063,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63bea4d-b5') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf63bea4d-b5, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf63bea4d-b5, col_values=(('external_ids', {'iface-id': 'f63bea4d-b5cf-4137-b058-4d3a0f0a2063', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:27:7a', 'vm-uuid': '01162bf0-7e42-4926-95e3-a286827e16bf'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:46 user nova-compute[72818]: INFO os_vif [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:27:7a,bridge_name='br-int',has_traffic_filtering=True,id=f63bea4d-b5cf-4137-b058-4d3a0f0a2063,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63bea4d-b5')
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No VIF found with MAC fa:16:3e:22:27:7a, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.network.neutron [req-a3949775-ca2e-4388-a379-161da1c24c02 req-b194c50e-24fe-43bd-8d5a-d5a2b185615c service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Updated VIF entry in instance network info cache for port f63bea4d-b5cf-4137-b058-4d3a0f0a2063. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG nova.network.neutron [req-a3949775-ca2e-4388-a379-161da1c24c02 req-b194c50e-24fe-43bd-8d5a-d5a2b185615c service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Updating instance_info_cache with network_info: [{"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:37:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a3949775-ca2e-4388-a379-161da1c24c02 req-b194c50e-24fe-43bd-8d5a-d5a2b185615c service nova] Releasing lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:37:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-75dd5e25-c0d7-4ff4-af20-db67766ab580 req-c147ae21-7b3e-4fb3-a9ca-056dba5de15f service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Received event network-vif-plugged-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-75dd5e25-c0d7-4ff4-af20-db67766ab580 req-c147ae21-7b3e-4fb3-a9ca-056dba5de15f service nova] Acquiring lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-75dd5e25-c0d7-4ff4-af20-db67766ab580 req-c147ae21-7b3e-4fb3-a9ca-056dba5de15f service nova] Lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-75dd5e25-c0d7-4ff4-af20-db67766ab580 req-c147ae21-7b3e-4fb3-a9ca-056dba5de15f service nova] Lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-75dd5e25-c0d7-4ff4-af20-db67766ab580 req-c147ae21-7b3e-4fb3-a9ca-056dba5de15f service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] No waiting events found dispatching network-vif-plugged-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:37:48 user nova-compute[72818]: WARNING nova.compute.manager [req-75dd5e25-c0d7-4ff4-af20-db67766ab580 req-c147ae21-7b3e-4fb3-a9ca-056dba5de15f service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Received unexpected event network-vif-plugged-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 for instance with vm_state building and task_state spawning.
Aug 17 21:37:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308270.0098186, 01162bf0-7e42-4926-95e3-a286827e16bf => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:37:50 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] VM Resumed (Lifecycle Event)
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:37:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Instance spawned successfully.
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:37:50 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308270.0143297, 01162bf0-7e42-4926-95e3-a286827e16bf => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:37:50 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] VM Started (Lifecycle Event)
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:37:50 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:37:50 user nova-compute[72818]: INFO nova.compute.manager [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Took 5.52 seconds to spawn the instance on the hypervisor.
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:37:50 user nova-compute[72818]: INFO nova.compute.manager [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Took 6.17 seconds to build instance.
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-1b57ccdc-c7f5-4e38-96de-e3b420377400 req-4c108df8-11ca-4235-93ca-b1b121854091 service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Received event network-vif-plugged-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1b57ccdc-c7f5-4e38-96de-e3b420377400 req-4c108df8-11ca-4235-93ca-b1b121854091 service nova] Acquiring lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1b57ccdc-c7f5-4e38-96de-e3b420377400 req-4c108df8-11ca-4235-93ca-b1b121854091 service nova] Lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1b57ccdc-c7f5-4e38-96de-e3b420377400 req-4c108df8-11ca-4235-93ca-b1b121854091 service nova] Lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-1b57ccdc-c7f5-4e38-96de-e3b420377400 req-4c108df8-11ca-4235-93ca-b1b121854091 service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] No waiting events found dispatching network-vif-plugged-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:37:50 user nova-compute[72818]: WARNING nova.compute.manager [req-1b57ccdc-c7f5-4e38-96de-e3b420377400 req-4c108df8-11ca-4235-93ca-b1b121854091 service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Received unexpected event network-vif-plugged-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 for instance with vm_state active and task_state None.
Aug 17 21:37:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-debfd1f8-be44-451b-99d3-00d046d1c84f tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "01162bf0-7e42-4926-95e3-a286827e16bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.320s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:37:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:37:59 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308264.1266425, e322a0ce-e887-4e29-a5c4-a0da74db3c7f => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:37:59 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] VM Stopped (Lifecycle Event)
Aug 17 21:37:59 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e383be2b-ee43-448e-83b8-108a97def392 None None] [instance: e322a0ce-e887-4e29-a5c4-a0da74db3c7f] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:38:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:02 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:38:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:38:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:38:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-9b67dba5-8370-4a91-b819-8dd509bcbb61 req-f4f59bab-b91c-4c14-8318-21f169b42091 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Received event network-changed-4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-9b67dba5-8370-4a91-b819-8dd509bcbb61 req-f4f59bab-b91c-4c14-8318-21f169b42091 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Refreshing instance network info cache due to event network-changed-4874c588-3034-4936-bed2-a61d132e3a45. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:38:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9b67dba5-8370-4a91-b819-8dd509bcbb61 req-f4f59bab-b91c-4c14-8318-21f169b42091 service nova] Acquiring lock "refresh_cache-aee17e23-ac55-4c71-bd40-a9315b1294ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:38:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9b67dba5-8370-4a91-b819-8dd509bcbb61 req-f4f59bab-b91c-4c14-8318-21f169b42091 service nova] Acquired lock "refresh_cache-aee17e23-ac55-4c71-bd40-a9315b1294ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:38:07 user nova-compute[72818]: DEBUG nova.network.neutron [req-9b67dba5-8370-4a91-b819-8dd509bcbb61 req-f4f59bab-b91c-4c14-8318-21f169b42091 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Refreshing network info cache for port 4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "aee17e23-ac55-4c71-bd40-a9315b1294ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG nova.network.neutron [req-9b67dba5-8370-4a91-b819-8dd509bcbb61 req-f4f59bab-b91c-4c14-8318-21f169b42091 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Updated VIF entry in instance network info cache for port 4874c588-3034-4936-bed2-a61d132e3a45. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG nova.network.neutron [req-9b67dba5-8370-4a91-b819-8dd509bcbb61 req-f4f59bab-b91c-4c14-8318-21f169b42091 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Updating instance_info_cache with network_info: [{"id": "4874c588-3034-4936-bed2-a61d132e3a45", "address": "fa:16:3e:b0:ae:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4874c588-30", "ovs_interfaceid": "4874c588-3034-4936-bed2-a61d132e3a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:38:08 user nova-compute[72818]: INFO nova.compute.manager [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Terminating instance
Aug 17 21:38:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9b67dba5-8370-4a91-b819-8dd509bcbb61 req-f4f59bab-b91c-4c14-8318-21f169b42091 service nova] Releasing lock "refresh_cache-aee17e23-ac55-4c71-bd40-a9315b1294ac" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ee13f690-0d9f-4619-b1a0-e5cc93cb9ec0 req-fe9c33f3-46e8-4625-b22e-aebaef9072e0 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Received event network-vif-unplugged-4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ee13f690-0d9f-4619-b1a0-e5cc93cb9ec0 req-fe9c33f3-46e8-4625-b22e-aebaef9072e0 service nova] Acquiring lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ee13f690-0d9f-4619-b1a0-e5cc93cb9ec0 req-fe9c33f3-46e8-4625-b22e-aebaef9072e0 service nova] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ee13f690-0d9f-4619-b1a0-e5cc93cb9ec0 req-fe9c33f3-46e8-4625-b22e-aebaef9072e0 service nova] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ee13f690-0d9f-4619-b1a0-e5cc93cb9ec0 req-fe9c33f3-46e8-4625-b22e-aebaef9072e0 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] No waiting events found dispatching network-vif-unplugged-4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-ee13f690-0d9f-4619-b1a0-e5cc93cb9ec0 req-fe9c33f3-46e8-4625-b22e-aebaef9072e0 service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Received event network-vif-unplugged-4874c588-3034-4936-bed2-a61d132e3a45 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Skipping network cache update for instance because it is being deleted. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-56e732de-965f-4d74-a9ca-ed75631e6f02" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-56e732de-965f-4d74-a9ca-ed75631e6f02" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:38:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:38:09 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Instance destroyed successfully.
Aug 17 21:38:09 user nova-compute[72818]: DEBUG nova.objects.instance [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lazy-loading 'resources' on Instance uuid aee17e23-ac55-4c71-bd40-a9315b1294ac {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:36:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-474651830',display_name='tempest-TestVolumeBootPattern-server-474651830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-474651830',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvgvYY4VEzOO1hBWsb20sNrMVs8w/XTYHCJEm0Bvp0JOphCdpXxCT+2Vc1RBvadH4gKZoKMMxsPeL8omuqOhZEcjdNF9Xh2fVwAM7u4vOVW7jR4hyrsil3xbR7zmO8kpg==',key_name='tempest-TestVolumeBootPattern-782174029',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:36:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-s9ti1bcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:36:33Z,user_data=None,user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=aee17e23-ac55-4c71-bd40-a9315b1294ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4874c588-3034-4936-bed2-a61d132e3a45", "address": "fa:16:3e:b0:ae:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4874c588-30", "ovs_interfaceid": "4874c588-3034-4936-bed2-a61d132e3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "4874c588-3034-4936-bed2-a61d132e3a45", "address": "fa:16:3e:b0:ae:da", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4874c588-30", "ovs_interfaceid": "4874c588-3034-4936-bed2-a61d132e3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ae:da,bridge_name='br-int',has_traffic_filtering=True,id=4874c588-3034-4936-bed2-a61d132e3a45,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4874c588-30') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_vif [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ae:da,bridge_name='br-int',has_traffic_filtering=True,id=4874c588-3034-4936-bed2-a61d132e3a45,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4874c588-30') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4874c588-30, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:38:09 user nova-compute[72818]: INFO os_vif [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ae:da,bridge_name='br-int',has_traffic_filtering=True,id=4874c588-3034-4936-bed2-a61d132e3a45,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4874c588-30')
Aug 17 21:38:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBJncWFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:38:09 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[41863790-b9fd-4082-bd76-a0878a198319]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb0d88e-d6f6-47d6-9d57-2c019fdeefe1]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:38:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:38:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04dfe680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1'): ({'sdd'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Removing single pathed devices sdd {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8797a380-c9b9-4bb7-90c7-3448a4c3e8c5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[57713a5e-8d45-450e-b0f9-d5b4834ffa86]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flushing IO for device /dev/sdd {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b713bfdb-2839-44cf-b420-4631fbeec692]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b98048-2668-43bf-9913-a7a898574192]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6c13a5d-8a12fd0e7e6ea6dc', '/dev/disk/by-id/scsi-23861313266643065', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6c13a5d') {{(pid=83620) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[948fcb9b-ca29-4732-9aa2-fd6e95aa0d81]: (4, None) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cfde34-7e6b-434f-bbdc-4e3f4479b4bb]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d509326d-4489-473a-a808-c6007cb04727]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260]
Aug 17 21:38:09 user nova-compute[72818]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260] successful.
Aug 17 21:38:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Updating instance_info_cache with network_info: [{"id": "254ce475-7668-4974-a621-10315c2ceca7", "address": "fa:16:3e:8c:04:26", "network": {"id": "6c11edcd-d873-4311-82c5-0847ce1c9abf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6438a8b236d74a9585300eb2b1ce044f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ce475-76", "ovs_interfaceid": "254ce475-7668-4974-a621-10315c2ceca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79ba95a-3f63-488f-babb-99917931fce8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== disconnect_volume: return (281ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:38:09 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Deleting instance files /opt/stack/data/nova/instances/aee17e23-ac55-4c71-bd40-a9315b1294ac_del
Aug 17 21:38:09 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Deletion of /opt/stack/data/nova/instances/aee17e23-ac55-4c71-bd40-a9315b1294ac_del complete
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-56e732de-965f-4d74-a9ca-ed75631e6f02" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:38:09 user nova-compute[72818]: INFO nova.compute.manager [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 17 21:38:09 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:38:09 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:38:10 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:38:10 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Took 1.01 seconds to deallocate network for instance.
Aug 17 21:38:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-cdd4b0c8-60f0-40af-bd44-88929500364c req-db9a7adb-3503-45ba-bc74-84c6cf054e0c service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Received event network-vif-deleted-4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-9a3a304b-add3-4d69-8b49-0d4fa2852fb3 req-636723c3-4ae3-458f-a3aa-41c9442c416e service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Received event network-vif-plugged-4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9a3a304b-add3-4d69-8b49-0d4fa2852fb3 req-636723c3-4ae3-458f-a3aa-41c9442c416e service nova] Acquiring lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9a3a304b-add3-4d69-8b49-0d4fa2852fb3 req-636723c3-4ae3-458f-a3aa-41c9442c416e service nova] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9a3a304b-add3-4d69-8b49-0d4fa2852fb3 req-636723c3-4ae3-458f-a3aa-41c9442c416e service nova] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:10 user nova-compute[72818]: DEBUG nova.compute.manager [req-9a3a304b-add3-4d69-8b49-0d4fa2852fb3 req-636723c3-4ae3-458f-a3aa-41c9442c416e service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] No waiting events found dispatching network-vif-plugged-4874c588-3034-4936-bed2-a61d132e3a45 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:38:10 user nova-compute[72818]: WARNING nova.compute.manager [req-9a3a304b-add3-4d69-8b49-0d4fa2852fb3 req-636723c3-4ae3-458f-a3aa-41c9442c416e service nova] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Received unexpected event network-vif-plugged-4874c588-3034-4936-bed2-a61d132e3a45 for instance with vm_state active and task_state deleting.
Aug 17 21:38:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:38:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:38:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:11 user nova-compute[72818]: INFO nova.compute.manager [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Took 0.86 seconds to detach 1 volumes for instance.
Aug 17 21:38:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:11 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:38:11 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:38:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:12 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Deleted allocations for instance aee17e23-ac55-4c71-bd40-a9315b1294ac
Aug 17 21:38:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:38:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:38:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8351MB free_disk=25.388263702392578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:38:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6d89c933-0c3d-400e-9de9-05d76bce5299 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "aee17e23-ac55-4c71-bd40-a9315b1294ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.786s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 56e732de-965f-4d74-a9ca-ed75631e6f02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:38:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 01162bf0-7e42-4926-95e3-a286827e16bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:38:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:38:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:38:12 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:38:12 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:38:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:38:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:38:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:38:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:38:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:14 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:38:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:24 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308289.1837456, aee17e23-ac55-4c71-bd40-a9315b1294ac => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:38:24 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] VM Stopped (Lifecycle Event)
Aug 17 21:38:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-24d9aebb-c757-423b-95e9-fc76d9598f3e None None] [instance: aee17e23-ac55-4c71-bd40-a9315b1294ac] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:38:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "20c956c3-eeba-4e85-ac6b-f50e050ee098" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:38:34 user nova-compute[72818]: INFO nova.compute.claims [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Claim successful on node user
Aug 17 21:38:34 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:38:34 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:38:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:38:34 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Creating image(s)
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "/opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "/opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "/opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG nova.policy [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6934fedf4fb46a4b9e1495aa20a6111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371d253c57734dcfacd1e7e37116258d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk 1073741824" returned: 0 in 0.048s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Cannot resize image /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lazy-loading 'migration_context' on Instance uuid 20c956c3-eeba-4e85-ac6b-f50e050ee098 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Ensure instance console log exists: /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Successfully created port: 67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:38:36 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Successfully updated port: 67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:38:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "refresh_cache-20c956c3-eeba-4e85-ac6b-f50e050ee098" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:38:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquired lock "refresh_cache-20c956c3-eeba-4e85-ac6b-f50e050ee098" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:38:36 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:38:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-0c6f538c-b5be-47f3-9d04-8e18bf70a78a req-f89aeeb9-1466-427b-bb2f-25de2a1d444b service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Received event network-changed-67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-0c6f538c-b5be-47f3-9d04-8e18bf70a78a req-f89aeeb9-1466-427b-bb2f-25de2a1d444b service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Refreshing instance network info cache due to event network-changed-67fc5332-848f-4511-9b1a-4faa3c21d35d. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:38:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0c6f538c-b5be-47f3-9d04-8e18bf70a78a req-f89aeeb9-1466-427b-bb2f-25de2a1d444b service nova] Acquiring lock "refresh_cache-20c956c3-eeba-4e85-ac6b-f50e050ee098" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:38:36 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Updating instance_info_cache with network_info: [{"id": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "address": "fa:16:3e:17:cd:d5", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67fc5332-84", "ovs_interfaceid": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Releasing lock "refresh_cache-20c956c3-eeba-4e85-ac6b-f50e050ee098" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Instance network_info: |[{"id": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "address": "fa:16:3e:17:cd:d5", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67fc5332-84", "ovs_interfaceid": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0c6f538c-b5be-47f3-9d04-8e18bf70a78a req-f89aeeb9-1466-427b-bb2f-25de2a1d444b service nova] Acquired lock "refresh_cache-20c956c3-eeba-4e85-ac6b-f50e050ee098" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-0c6f538c-b5be-47f3-9d04-8e18bf70a78a req-f89aeeb9-1466-427b-bb2f-25de2a1d444b service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Refreshing network info cache for port 67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Start _get_guest_xml network_info=[{"id": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "address": "fa:16:3e:17:cd:d5", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67fc5332-84", "ovs_interfaceid": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:38:37 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:38:37 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1399178584',display_name='tempest-VolumesActionsTest-instance-1399178584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1399178584',id=39,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='371d253c57734dcfacd1e7e37116258d',ramdisk_id='',reservation_id='r-5s2z9b0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-485654311',owner_user_name='tempest-VolumesActionsTest-485654311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:38:35Z,user_data=None,user_id='c6934fedf4fb46a4b9e1495aa20a6111',uuid=20c956c3-eeba-4e85-ac6b-f50e050ee098,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "address": "fa:16:3e:17:cd:d5", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67fc5332-84", "ovs_interfaceid": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Converting VIF {"id": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "address": "fa:16:3e:17:cd:d5", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67fc5332-84", "ovs_interfaceid": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:d5,bridge_name='br-int',has_traffic_filtering=True,id=67fc5332-848f-4511-9b1a-4faa3c21d35d,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67fc5332-84') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lazy-loading 'pci_devices' on Instance uuid 20c956c3-eeba-4e85-ac6b-f50e050ee098 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:38:37 user nova-compute[72818]:   <uuid>20c956c3-eeba-4e85-ac6b-f50e050ee098</uuid>
Aug 17 21:38:37 user nova-compute[72818]:   <name>instance-00000027</name>
Aug 17 21:38:37 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:38:37 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:38:37 user nova-compute[72818]:   <metadata>
Aug 17 21:38:37 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:38:37 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:38:37 user nova-compute[72818]:       <nova:name>tempest-VolumesActionsTest-instance-1399178584</nova:name>
Aug 17 21:38:37 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:38:37</nova:creationTime>
Aug 17 21:38:37 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:38:37 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:38:37 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:38:37 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:38:37 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:38:37 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:38:37 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:38:37 user nova-compute[72818]:       <nova:owner>
Aug 17 21:38:37 user nova-compute[72818]:         <nova:user uuid="c6934fedf4fb46a4b9e1495aa20a6111">tempest-VolumesActionsTest-485654311-project-member</nova:user>
Aug 17 21:38:37 user nova-compute[72818]:         <nova:project uuid="371d253c57734dcfacd1e7e37116258d">tempest-VolumesActionsTest-485654311</nova:project>
Aug 17 21:38:37 user nova-compute[72818]:       </nova:owner>
Aug 17 21:38:37 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:38:37 user nova-compute[72818]:       <nova:ports>
Aug 17 21:38:37 user nova-compute[72818]:         <nova:port uuid="67fc5332-848f-4511-9b1a-4faa3c21d35d">
Aug 17 21:38:37 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 21:38:37 user nova-compute[72818]:         </nova:port>
Aug 17 21:38:37 user nova-compute[72818]:       </nova:ports>
Aug 17 21:38:37 user nova-compute[72818]:     </nova:instance>
Aug 17 21:38:37 user nova-compute[72818]:   </metadata>
Aug 17 21:38:37 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:38:37 user nova-compute[72818]:     <system>
Aug 17 21:38:37 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:38:37 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:38:37 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:38:37 user nova-compute[72818]:       <entry name="serial">20c956c3-eeba-4e85-ac6b-f50e050ee098</entry>
Aug 17 21:38:37 user nova-compute[72818]:       <entry name="uuid">20c956c3-eeba-4e85-ac6b-f50e050ee098</entry>
Aug 17 21:38:37 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:38:37 user nova-compute[72818]:     </system>
Aug 17 21:38:37 user nova-compute[72818]:   </sysinfo>
Aug 17 21:38:37 user nova-compute[72818]:   <os>
Aug 17 21:38:37 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:38:37 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:38:37 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:38:37 user nova-compute[72818]:   </os>
Aug 17 21:38:37 user nova-compute[72818]:   <features>
Aug 17 21:38:37 user nova-compute[72818]:     <acpi/>
Aug 17 21:38:37 user nova-compute[72818]:     <apic/>
Aug 17 21:38:37 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:38:37 user nova-compute[72818]:   </features>
Aug 17 21:38:37 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:38:37 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:38:37 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:38:37 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:38:37 user nova-compute[72818]:   </clock>
Aug 17 21:38:37 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:38:37 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:38:37 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:38:37 user nova-compute[72818]:   </cpu>
Aug 17 21:38:37 user nova-compute[72818]:   <devices>
Aug 17 21:38:37 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:38:37 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:38:37 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk"/>
Aug 17 21:38:37 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:38:37 user nova-compute[72818]:     </disk>
Aug 17 21:38:37 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:38:37 user nova-compute[72818]:       <mac address="fa:16:3e:17:cd:d5"/>
Aug 17 21:38:37 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:38:37 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:38:37 user nova-compute[72818]:       <target dev="tap67fc5332-84"/>
Aug 17 21:38:37 user nova-compute[72818]:     </interface>
Aug 17 21:38:37 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:38:37 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/console.log" append="off"/>
Aug 17 21:38:37 user nova-compute[72818]:     </serial>
Aug 17 21:38:37 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:38:37 user nova-compute[72818]:     <video>
Aug 17 21:38:37 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:38:37 user nova-compute[72818]:     </video>
Aug 17 21:38:37 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:38:37 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:38:37 user nova-compute[72818]:     </rng>
Aug 17 21:38:37 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:38:37 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:38:37 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:38:37 user nova-compute[72818]:     </memballoon>
Aug 17 21:38:37 user nova-compute[72818]:   </devices>
Aug 17 21:38:37 user nova-compute[72818]: </domain>
Aug 17 21:38:37 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1399178584',display_name='tempest-VolumesActionsTest-instance-1399178584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1399178584',id=39,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='371d253c57734dcfacd1e7e37116258d',ramdisk_id='',reservation_id='r-5s2z9b0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-485654311',owner_user_name='tempest-VolumesActionsTest-485654311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:38:35Z,user_data=None,user_id='c6934fedf4fb46a4b9e1495aa20a6111',uuid=20c956c3-eeba-4e85-ac6b-f50e050ee098,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "address": "fa:16:3e:17:cd:d5", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67fc5332-84", "ovs_interfaceid": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Converting VIF {"id": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "address": "fa:16:3e:17:cd:d5", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67fc5332-84", "ovs_interfaceid": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:d5,bridge_name='br-int',has_traffic_filtering=True,id=67fc5332-848f-4511-9b1a-4faa3c21d35d,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67fc5332-84') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG os_vif [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:d5,bridge_name='br-int',has_traffic_filtering=True,id=67fc5332-848f-4511-9b1a-4faa3c21d35d,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67fc5332-84') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67fc5332-84, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67fc5332-84, col_values=(('external_ids', {'iface-id': '67fc5332-848f-4511-9b1a-4faa3c21d35d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:cd:d5', 'vm-uuid': '20c956c3-eeba-4e85-ac6b-f50e050ee098'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:37 user nova-compute[72818]: INFO os_vif [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:d5,bridge_name='br-int',has_traffic_filtering=True,id=67fc5332-848f-4511-9b1a-4faa3c21d35d,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67fc5332-84')
Aug 17 21:38:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] No VIF found with MAC fa:16:3e:17:cd:d5, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-0c6f538c-b5be-47f3-9d04-8e18bf70a78a req-f89aeeb9-1466-427b-bb2f-25de2a1d444b service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Updated VIF entry in instance network info cache for port 67fc5332-848f-4511-9b1a-4faa3c21d35d. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-0c6f538c-b5be-47f3-9d04-8e18bf70a78a req-f89aeeb9-1466-427b-bb2f-25de2a1d444b service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Updating instance_info_cache with network_info: [{"id": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "address": "fa:16:3e:17:cd:d5", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67fc5332-84", "ovs_interfaceid": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-0c6f538c-b5be-47f3-9d04-8e18bf70a78a req-f89aeeb9-1466-427b-bb2f-25de2a1d444b service nova] Releasing lock "refresh_cache-20c956c3-eeba-4e85-ac6b-f50e050ee098" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:38:37 user nova-compute[72818]: INFO nova.compute.claims [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Claim successful on node user
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:38:37 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG nova.network.neutron [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:38:38 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:38:38 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG nova.policy [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10aff1c23f1041c485ab50735d2dcc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6482e624bb9417598bb26fa0622641d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:38:38 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Creating image(s)
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "/opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "/opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "/opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.198s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk 1073741824" returned: 0 in 0.051s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-8f5f3ade-a354-49f6-961e-fbcf3b6cff0d req-cf944429-33bf-497c-b96e-36d5797c73b0 service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Received event network-vif-plugged-67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8f5f3ade-a354-49f6-961e-fbcf3b6cff0d req-cf944429-33bf-497c-b96e-36d5797c73b0 service nova] Acquiring lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8f5f3ade-a354-49f6-961e-fbcf3b6cff0d req-cf944429-33bf-497c-b96e-36d5797c73b0 service nova] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8f5f3ade-a354-49f6-961e-fbcf3b6cff0d req-cf944429-33bf-497c-b96e-36d5797c73b0 service nova] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-8f5f3ade-a354-49f6-961e-fbcf3b6cff0d req-cf944429-33bf-497c-b96e-36d5797c73b0 service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] No waiting events found dispatching network-vif-plugged-67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:38:38 user nova-compute[72818]: WARNING nova.compute.manager [req-8f5f3ade-a354-49f6-961e-fbcf3b6cff0d req-cf944429-33bf-497c-b96e-36d5797c73b0 service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Received unexpected event network-vif-plugged-67fc5332-848f-4511-9b1a-4faa3c21d35d for instance with vm_state building and task_state spawning.
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.194s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:38:38 user nova-compute[72818]: DEBUG nova.network.neutron [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Successfully created port: a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Cannot resize image /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'migration_context' on Instance uuid 44c0f255-d86e-4799-99be-32f00b897a17 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Ensure instance console log exists: /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG nova.network.neutron [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Successfully updated port: a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "refresh_cache-44c0f255-d86e-4799-99be-32f00b897a17" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquired lock "refresh_cache-44c0f255-d86e-4799-99be-32f00b897a17" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG nova.network.neutron [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG nova.compute.manager [req-9d4fc46e-d4cf-47fc-9011-73d7164c3411 req-faf082cf-cdae-4a53-a971-227cf7dc5315 service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Received event network-changed-a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG nova.compute.manager [req-9d4fc46e-d4cf-47fc-9011-73d7164c3411 req-faf082cf-cdae-4a53-a971-227cf7dc5315 service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Refreshing instance network info cache due to event network-changed-a0f3842b-4aa7-4921-abd1-07a633536d86. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9d4fc46e-d4cf-47fc-9011-73d7164c3411 req-faf082cf-cdae-4a53-a971-227cf7dc5315 service nova] Acquiring lock "refresh_cache-44c0f255-d86e-4799-99be-32f00b897a17" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:38:39 user nova-compute[72818]: DEBUG nova.network.neutron [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.network.neutron [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Updating instance_info_cache with network_info: [{"id": "a0f3842b-4aa7-4921-abd1-07a633536d86", "address": "fa:16:3e:24:48:82", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f3842b-4a", "ovs_interfaceid": "a0f3842b-4aa7-4921-abd1-07a633536d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Releasing lock "refresh_cache-44c0f255-d86e-4799-99be-32f00b897a17" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Instance network_info: |[{"id": "a0f3842b-4aa7-4921-abd1-07a633536d86", "address": "fa:16:3e:24:48:82", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f3842b-4a", "ovs_interfaceid": "a0f3842b-4aa7-4921-abd1-07a633536d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9d4fc46e-d4cf-47fc-9011-73d7164c3411 req-faf082cf-cdae-4a53-a971-227cf7dc5315 service nova] Acquired lock "refresh_cache-44c0f255-d86e-4799-99be-32f00b897a17" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.network.neutron [req-9d4fc46e-d4cf-47fc-9011-73d7164c3411 req-faf082cf-cdae-4a53-a971-227cf7dc5315 service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Refreshing network info cache for port a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Start _get_guest_xml network_info=[{"id": "a0f3842b-4aa7-4921-abd1-07a633536d86", "address": "fa:16:3e:24:48:82", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f3842b-4a", "ovs_interfaceid": "a0f3842b-4aa7-4921-abd1-07a633536d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:38:40 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:38:40 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1467637435',display_name='tempest-AttachVolumeTestJSON-server-1467637435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1467637435',id=40,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJh1ITYS/Ro8RhbB+rmxuFen572WpqwyPO8gT1+kE8nda8CNyVQMfiu2HHJ6GQ4bxnVu46Q5i/PgZwJhVBf5tYytZJIzcgGv5yQXqevuFynpNdzyvbC+/qPmPOz2qRvIw==',key_name='tempest-keypair-1616055024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6482e624bb9417598bb26fa0622641d',ramdisk_id='',reservation_id='r-inpmzaz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1086990444',owner_user_name='tempest-AttachVolumeTestJSON-1086990444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10aff1c23f1041c485ab50735d2dcc12',uuid=44c0f255-d86e-4799-99be-32f00b897a17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0f3842b-4aa7-4921-abd1-07a633536d86", "address": "fa:16:3e:24:48:82", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f3842b-4a", "ovs_interfaceid": "a0f3842b-4aa7-4921-abd1-07a633536d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converting VIF {"id": "a0f3842b-4aa7-4921-abd1-07a633536d86", "address": "fa:16:3e:24:48:82", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f3842b-4a", "ovs_interfaceid": "a0f3842b-4aa7-4921-abd1-07a633536d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:48:82,bridge_name='br-int',has_traffic_filtering=True,id=a0f3842b-4aa7-4921-abd1-07a633536d86,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f3842b-4a') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'pci_devices' on Instance uuid 44c0f255-d86e-4799-99be-32f00b897a17 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:38:40 user nova-compute[72818]:   <uuid>44c0f255-d86e-4799-99be-32f00b897a17</uuid>
Aug 17 21:38:40 user nova-compute[72818]:   <name>instance-00000028</name>
Aug 17 21:38:40 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:38:40 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:38:40 user nova-compute[72818]:   <metadata>
Aug 17 21:38:40 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:38:40 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:38:40 user nova-compute[72818]:       <nova:name>tempest-AttachVolumeTestJSON-server-1467637435</nova:name>
Aug 17 21:38:40 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:38:40</nova:creationTime>
Aug 17 21:38:40 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:38:40 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:38:40 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:38:40 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:38:40 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:38:40 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:38:40 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:38:40 user nova-compute[72818]:       <nova:owner>
Aug 17 21:38:40 user nova-compute[72818]:         <nova:user uuid="10aff1c23f1041c485ab50735d2dcc12">tempest-AttachVolumeTestJSON-1086990444-project-member</nova:user>
Aug 17 21:38:40 user nova-compute[72818]:         <nova:project uuid="d6482e624bb9417598bb26fa0622641d">tempest-AttachVolumeTestJSON-1086990444</nova:project>
Aug 17 21:38:40 user nova-compute[72818]:       </nova:owner>
Aug 17 21:38:40 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:38:40 user nova-compute[72818]:       <nova:ports>
Aug 17 21:38:40 user nova-compute[72818]:         <nova:port uuid="a0f3842b-4aa7-4921-abd1-07a633536d86">
Aug 17 21:38:40 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 21:38:40 user nova-compute[72818]:         </nova:port>
Aug 17 21:38:40 user nova-compute[72818]:       </nova:ports>
Aug 17 21:38:40 user nova-compute[72818]:     </nova:instance>
Aug 17 21:38:40 user nova-compute[72818]:   </metadata>
Aug 17 21:38:40 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:38:40 user nova-compute[72818]:     <system>
Aug 17 21:38:40 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:38:40 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:38:40 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:38:40 user nova-compute[72818]:       <entry name="serial">44c0f255-d86e-4799-99be-32f00b897a17</entry>
Aug 17 21:38:40 user nova-compute[72818]:       <entry name="uuid">44c0f255-d86e-4799-99be-32f00b897a17</entry>
Aug 17 21:38:40 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:38:40 user nova-compute[72818]:     </system>
Aug 17 21:38:40 user nova-compute[72818]:   </sysinfo>
Aug 17 21:38:40 user nova-compute[72818]:   <os>
Aug 17 21:38:40 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:38:40 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:38:40 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:38:40 user nova-compute[72818]:   </os>
Aug 17 21:38:40 user nova-compute[72818]:   <features>
Aug 17 21:38:40 user nova-compute[72818]:     <acpi/>
Aug 17 21:38:40 user nova-compute[72818]:     <apic/>
Aug 17 21:38:40 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:38:40 user nova-compute[72818]:   </features>
Aug 17 21:38:40 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:38:40 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:38:40 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:38:40 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:38:40 user nova-compute[72818]:   </clock>
Aug 17 21:38:40 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:38:40 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:38:40 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:38:40 user nova-compute[72818]:   </cpu>
Aug 17 21:38:40 user nova-compute[72818]:   <devices>
Aug 17 21:38:40 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:38:40 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:38:40 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk"/>
Aug 17 21:38:40 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:38:40 user nova-compute[72818]:     </disk>
Aug 17 21:38:40 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:38:40 user nova-compute[72818]:       <mac address="fa:16:3e:24:48:82"/>
Aug 17 21:38:40 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:38:40 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:38:40 user nova-compute[72818]:       <target dev="tapa0f3842b-4a"/>
Aug 17 21:38:40 user nova-compute[72818]:     </interface>
Aug 17 21:38:40 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:38:40 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/console.log" append="off"/>
Aug 17 21:38:40 user nova-compute[72818]:     </serial>
Aug 17 21:38:40 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:38:40 user nova-compute[72818]:     <video>
Aug 17 21:38:40 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:38:40 user nova-compute[72818]:     </video>
Aug 17 21:38:40 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:38:40 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:38:40 user nova-compute[72818]:     </rng>
Aug 17 21:38:40 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:38:40 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:38:40 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:38:40 user nova-compute[72818]:     </memballoon>
Aug 17 21:38:40 user nova-compute[72818]:   </devices>
Aug 17 21:38:40 user nova-compute[72818]: </domain>
Aug 17 21:38:40 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1467637435',display_name='tempest-AttachVolumeTestJSON-server-1467637435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1467637435',id=40,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJh1ITYS/Ro8RhbB+rmxuFen572WpqwyPO8gT1+kE8nda8CNyVQMfiu2HHJ6GQ4bxnVu46Q5i/PgZwJhVBf5tYytZJIzcgGv5yQXqevuFynpNdzyvbC+/qPmPOz2qRvIw==',key_name='tempest-keypair-1616055024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6482e624bb9417598bb26fa0622641d',ramdisk_id='',reservation_id='r-inpmzaz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1086990444',owner_user_name='tempest-AttachVolumeTestJSON-1086990444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10aff1c23f1041c485ab50735d2dcc12',uuid=44c0f255-d86e-4799-99be-32f00b897a17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0f3842b-4aa7-4921-abd1-07a633536d86", "address": "fa:16:3e:24:48:82", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f3842b-4a", "ovs_interfaceid": "a0f3842b-4aa7-4921-abd1-07a633536d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converting VIF {"id": "a0f3842b-4aa7-4921-abd1-07a633536d86", "address": "fa:16:3e:24:48:82", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f3842b-4a", "ovs_interfaceid": "a0f3842b-4aa7-4921-abd1-07a633536d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:48:82,bridge_name='br-int',has_traffic_filtering=True,id=a0f3842b-4aa7-4921-abd1-07a633536d86,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f3842b-4a') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG os_vif [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:48:82,bridge_name='br-int',has_traffic_filtering=True,id=a0f3842b-4aa7-4921-abd1-07a633536d86,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f3842b-4a') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0f3842b-4a, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0f3842b-4a, col_values=(('external_ids', {'iface-id': 'a0f3842b-4aa7-4921-abd1-07a633536d86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:48:82', 'vm-uuid': '44c0f255-d86e-4799-99be-32f00b897a17'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:40 user nova-compute[72818]: INFO os_vif [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:48:82,bridge_name='br-int',has_traffic_filtering=True,id=a0f3842b-4aa7-4921-abd1-07a633536d86,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f3842b-4a')
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No VIF found with MAC fa:16:3e:24:48:82, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.network.neutron [req-9d4fc46e-d4cf-47fc-9011-73d7164c3411 req-faf082cf-cdae-4a53-a971-227cf7dc5315 service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Updated VIF entry in instance network info cache for port a0f3842b-4aa7-4921-abd1-07a633536d86. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.network.neutron [req-9d4fc46e-d4cf-47fc-9011-73d7164c3411 req-faf082cf-cdae-4a53-a971-227cf7dc5315 service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Updating instance_info_cache with network_info: [{"id": "a0f3842b-4aa7-4921-abd1-07a633536d86", "address": "fa:16:3e:24:48:82", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f3842b-4a", "ovs_interfaceid": "a0f3842b-4aa7-4921-abd1-07a633536d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9d4fc46e-d4cf-47fc-9011-73d7164c3411 req-faf082cf-cdae-4a53-a971-227cf7dc5315 service nova] Releasing lock "refresh_cache-44c0f255-d86e-4799-99be-32f00b897a17" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308320.5645583, 20c956c3-eeba-4e85-ac6b-f50e050ee098 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:38:40 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] VM Resumed (Lifecycle Event)
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:38:40 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Instance spawned successfully.
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:38:40 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308320.565768, 20c956c3-eeba-4e85-ac6b-f50e050ee098 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:38:40 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] VM Started (Lifecycle Event)
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:38:40 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:38:40 user nova-compute[72818]: INFO nova.compute.manager [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:38:40 user nova-compute[72818]: INFO nova.compute.manager [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Took 6.45 seconds to build instance.
Aug 17 21:38:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f9188b32-855d-447d-b520-c18d4ece731e tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.536s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-ef5b8516-6025-46fa-aeab-a55a10aacd36 req-222bbded-1790-4874-bf8c-e71c9a1c0da5 service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Received event network-vif-plugged-67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ef5b8516-6025-46fa-aeab-a55a10aacd36 req-222bbded-1790-4874-bf8c-e71c9a1c0da5 service nova] Acquiring lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ef5b8516-6025-46fa-aeab-a55a10aacd36 req-222bbded-1790-4874-bf8c-e71c9a1c0da5 service nova] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ef5b8516-6025-46fa-aeab-a55a10aacd36 req-222bbded-1790-4874-bf8c-e71c9a1c0da5 service nova] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:40 user nova-compute[72818]: DEBUG nova.compute.manager [req-ef5b8516-6025-46fa-aeab-a55a10aacd36 req-222bbded-1790-4874-bf8c-e71c9a1c0da5 service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] No waiting events found dispatching network-vif-plugged-67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:38:40 user nova-compute[72818]: WARNING nova.compute.manager [req-ef5b8516-6025-46fa-aeab-a55a10aacd36 req-222bbded-1790-4874-bf8c-e71c9a1c0da5 service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Received unexpected event network-vif-plugged-67fc5332-848f-4511-9b1a-4faa3c21d35d for instance with vm_state active and task_state None.
Aug 17 21:38:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-b3f9cc71-073c-44c2-a63d-3e5bf074a46b req-adda1363-5ba9-4542-bfff-5b8c10ec45cd service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Received event network-vif-plugged-a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b3f9cc71-073c-44c2-a63d-3e5bf074a46b req-adda1363-5ba9-4542-bfff-5b8c10ec45cd service nova] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b3f9cc71-073c-44c2-a63d-3e5bf074a46b req-adda1363-5ba9-4542-bfff-5b8c10ec45cd service nova] Lock "44c0f255-d86e-4799-99be-32f00b897a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b3f9cc71-073c-44c2-a63d-3e5bf074a46b req-adda1363-5ba9-4542-bfff-5b8c10ec45cd service nova] Lock "44c0f255-d86e-4799-99be-32f00b897a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-b3f9cc71-073c-44c2-a63d-3e5bf074a46b req-adda1363-5ba9-4542-bfff-5b8c10ec45cd service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] No waiting events found dispatching network-vif-plugged-a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:38:41 user nova-compute[72818]: WARNING nova.compute.manager [req-b3f9cc71-073c-44c2-a63d-3e5bf074a46b req-adda1363-5ba9-4542-bfff-5b8c10ec45cd service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Received unexpected event network-vif-plugged-a0f3842b-4aa7-4921-abd1-07a633536d86 for instance with vm_state building and task_state spawning.
Aug 17 21:38:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308323.6976814, 44c0f255-d86e-4799-99be-32f00b897a17 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:38:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] VM Resumed (Lifecycle Event)
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:38:43 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Instance spawned successfully.
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:38:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308323.6987503, 44c0f255-d86e-4799-99be-32f00b897a17 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:38:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] VM Started (Lifecycle Event)
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:38:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:38:43 user nova-compute[72818]: INFO nova.compute.manager [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:38:43 user nova-compute[72818]: INFO nova.compute.manager [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Took 6.18 seconds to build instance.
Aug 17 21:38:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5e87c64-4b4f-4aa0-8d8f-8b487d05932c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.273s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-b33193a8-3605-4a59-837a-ee7a809d7a58 req-ef3ba100-217d-4603-accb-c64179c795ef service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Received event network-vif-plugged-a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b33193a8-3605-4a59-837a-ee7a809d7a58 req-ef3ba100-217d-4603-accb-c64179c795ef service nova] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b33193a8-3605-4a59-837a-ee7a809d7a58 req-ef3ba100-217d-4603-accb-c64179c795ef service nova] Lock "44c0f255-d86e-4799-99be-32f00b897a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b33193a8-3605-4a59-837a-ee7a809d7a58 req-ef3ba100-217d-4603-accb-c64179c795ef service nova] Lock "44c0f255-d86e-4799-99be-32f00b897a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-b33193a8-3605-4a59-837a-ee7a809d7a58 req-ef3ba100-217d-4603-accb-c64179c795ef service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] No waiting events found dispatching network-vif-plugged-a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:38:43 user nova-compute[72818]: WARNING nova.compute.manager [req-b33193a8-3605-4a59-837a-ee7a809d7a58 req-ef3ba100-217d-4603-accb-c64179c795ef service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Received unexpected event network-vif-plugged-a0f3842b-4aa7-4921-abd1-07a633536d86 for instance with vm_state active and task_state None.
Aug 17 21:38:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Acquiring lock "56e732de-965f-4d74-a9ca-ed75631e6f02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Acquiring lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:48 user nova-compute[72818]: INFO nova.compute.manager [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Terminating instance
Aug 17 21:38:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-e4d09717-19a4-4bf9-b62d-59db37b4be66 req-ca8dcab1-5e39-497c-8d17-5f907b29a30c service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Received event network-vif-unplugged-254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e4d09717-19a4-4bf9-b62d-59db37b4be66 req-ca8dcab1-5e39-497c-8d17-5f907b29a30c service nova] Acquiring lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e4d09717-19a4-4bf9-b62d-59db37b4be66 req-ca8dcab1-5e39-497c-8d17-5f907b29a30c service nova] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e4d09717-19a4-4bf9-b62d-59db37b4be66 req-ca8dcab1-5e39-497c-8d17-5f907b29a30c service nova] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-e4d09717-19a4-4bf9-b62d-59db37b4be66 req-ca8dcab1-5e39-497c-8d17-5f907b29a30c service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] No waiting events found dispatching network-vif-unplugged-254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:38:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-e4d09717-19a4-4bf9-b62d-59db37b4be66 req-ca8dcab1-5e39-497c-8d17-5f907b29a30c service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Received event network-vif-unplugged-254ce475-7668-4974-a621-10315c2ceca7 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:49 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Instance destroyed successfully.
Aug 17 21:38:49 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lazy-loading 'resources' on Instance uuid 56e732de-965f-4d74-a9ca-ed75631e6f02 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-395309725',display_name='tempest-VolumesNegativeTest-instance-395309725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-395309725',id=37,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:37:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb70e73ae48d43bead27304e7050b27c',ramdisk_id='',reservation_id='r-ojayof8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1719328213',owner_user_name='tempest-VolumesNegativeTest-1719328213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:37:04Z,user_data=None,user_id='8e6d89bf123d4d4caa506e1ba2bcecd5',uuid=56e732de-965f-4d74-a9ca-ed75631e6f02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254ce475-7668-4974-a621-10315c2ceca7", "address": "fa:16:3e:8c:04:26", "network": {"id": "6c11edcd-d873-4311-82c5-0847ce1c9abf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6438a8b236d74a9585300eb2b1ce044f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ce475-76", "ovs_interfaceid": "254ce475-7668-4974-a621-10315c2ceca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Converting VIF {"id": "254ce475-7668-4974-a621-10315c2ceca7", "address": "fa:16:3e:8c:04:26", "network": {"id": "6c11edcd-d873-4311-82c5-0847ce1c9abf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6438a8b236d74a9585300eb2b1ce044f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ce475-76", "ovs_interfaceid": "254ce475-7668-4974-a621-10315c2ceca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:04:26,bridge_name='br-int',has_traffic_filtering=True,id=254ce475-7668-4974-a621-10315c2ceca7,network=Network(6c11edcd-d873-4311-82c5-0847ce1c9abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ce475-76') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG os_vif [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:04:26,bridge_name='br-int',has_traffic_filtering=True,id=254ce475-7668-4974-a621-10315c2ceca7,network=Network(6c11edcd-d873-4311-82c5-0847ce1c9abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ce475-76') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap254ce475-76, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:38:49 user nova-compute[72818]: INFO os_vif [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:04:26,bridge_name='br-int',has_traffic_filtering=True,id=254ce475-7668-4974-a621-10315c2ceca7,network=Network(6c11edcd-d873-4311-82c5-0847ce1c9abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ce475-76')
Aug 17 21:38:49 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Deleting instance files /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02_del
Aug 17 21:38:49 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Deletion of /opt/stack/data/nova/instances/56e732de-965f-4d74-a9ca-ed75631e6f02_del complete
Aug 17 21:38:49 user nova-compute[72818]: INFO nova.compute.manager [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 21:38:49 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:49 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Took 0.55 seconds to deallocate network for instance.
Aug 17 21:38:49 user nova-compute[72818]: DEBUG nova.compute.manager [req-8fe7837f-d18c-4c26-ad2d-14c0593db553 req-a64b64e0-5986-463c-b170-4c93e3b2878c service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Received event network-vif-deleted-254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:38:49 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:38:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:50 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Deleted allocations for instance 56e732de-965f-4d74-a9ca-ed75631e6f02
Aug 17 21:38:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d739f31b-9969-4236-a282-f8594535303d tempest-VolumesNegativeTest-1719328213 tempest-VolumesNegativeTest-1719328213-project-member] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.858s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-8472d228-27a2-4da6-93a3-4acd48a2ff8b req-6a894fb7-c391-4857-b8c6-86418e1c5da3 service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Received event network-vif-plugged-254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:38:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8472d228-27a2-4da6-93a3-4acd48a2ff8b req-6a894fb7-c391-4857-b8c6-86418e1c5da3 service nova] Acquiring lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:38:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8472d228-27a2-4da6-93a3-4acd48a2ff8b req-6a894fb7-c391-4857-b8c6-86418e1c5da3 service nova] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:38:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8472d228-27a2-4da6-93a3-4acd48a2ff8b req-6a894fb7-c391-4857-b8c6-86418e1c5da3 service nova] Lock "56e732de-965f-4d74-a9ca-ed75631e6f02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:38:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-8472d228-27a2-4da6-93a3-4acd48a2ff8b req-6a894fb7-c391-4857-b8c6-86418e1c5da3 service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] No waiting events found dispatching network-vif-plugged-254ce475-7668-4974-a621-10315c2ceca7 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:38:50 user nova-compute[72818]: WARNING nova.compute.manager [req-8472d228-27a2-4da6-93a3-4acd48a2ff8b req-6a894fb7-c391-4857-b8c6-86418e1c5da3 service nova] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Received unexpected event network-vif-plugged-254ce475-7668-4974-a621-10315c2ceca7 for instance with vm_state deleted and task_state None.
Aug 17 21:38:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:38:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:39:00 user nova-compute[72818]: INFO nova.compute.claims [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Claim successful on node user
Aug 17 21:39:00 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:39:00 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:39:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:39:00 user nova-compute[72818]: INFO nova.virt.block_device [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Booting with volume 68a9d689-8136-4eca-8e34-4125f727c3e1 at /dev/vda
Aug 17 21:39:00 user nova-compute[72818]: DEBUG nova.policy [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de902559a8794d1a8af9c0efbed4e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92abc22a192a44398dffe75ffae6d270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG os_brick.utils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1821c81-2791-485d-9018-50a7623cbba6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0c14f4-4f95-4714-a341-1f5ea12f1fe9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[540e51df-dbfd-4a25-b6af-424222b0ec31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc619fc-2192-4d4e-a85e-f1c47f6b0cbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:39:00 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:39:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[242124e1-b0df-46ec-aa56-e907b614d469]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG os_brick.utils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:39:00 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Updating existing volume attachment record: 30e73d9f-3c8b-44b4-8ca5-4400d315fad7 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:39:01 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Successfully created port: 36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Successfully updated port: 36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquired lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-a0ed9d70-cab9-4550-8658-1c8f6cf26105 req-ab84960d-8420-49c1-873b-b5c24815f9cc service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-changed-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-a0ed9d70-cab9-4550-8658-1c8f6cf26105 req-ab84960d-8420-49c1-873b-b5c24815f9cc service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Refreshing instance network info cache due to event network-changed-36e2738b-21a2-4fa8-8298-e03350a6fc5c. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0ed9d70-cab9-4550-8658-1c8f6cf26105 req-ab84960d-8420-49c1-873b-b5c24815f9cc service nova] Acquiring lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG nova.network.neutron [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Updating instance_info_cache with network_info: [{"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Releasing lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Instance network_info: |[{"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0ed9d70-cab9-4550-8658-1c8f6cf26105 req-ab84960d-8420-49c1-873b-b5c24815f9cc service nova] Acquired lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG nova.network.neutron [req-a0ed9d70-cab9-4550-8658-1c8f6cf26105 req-ab84960d-8420-49c1-873b-b5c24815f9cc service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Refreshing network info cache for port 36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:39:02 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:39:03 user nova-compute[72818]: DEBUG nova.network.neutron [req-a0ed9d70-cab9-4550-8658-1c8f6cf26105 req-ab84960d-8420-49c1-873b-b5c24815f9cc service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Updated VIF entry in instance network info cache for port 36e2738b-21a2-4fa8-8298-e03350a6fc5c. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:39:03 user nova-compute[72818]: DEBUG nova.network.neutron [req-a0ed9d70-cab9-4550-8658-1c8f6cf26105 req-ab84960d-8420-49c1-873b-b5c24815f9cc service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Updating instance_info_cache with network_info: [{"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:39:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a0ed9d70-cab9-4550-8658-1c8f6cf26105 req-ab84960d-8420-49c1-873b-b5c24815f9cc service nova] Releasing lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:39:04 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308329.0702064, 56e732de-965f-4d74-a9ca-ed75631e6f02 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:39:04 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] VM Stopped (Lifecycle Event)
Aug 17 21:39:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-280df3c2-1d78-4618-8ea2-7eabad4a0db1 None None] [instance: 56e732de-965f-4d74-a9ca-ed75631e6f02] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:39:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:06 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:39:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:08 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:39:08 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:39:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:09 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:39:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:39:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:39:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Skipping network cache update for instance because it is Building. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 21:39:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:39:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:39:09 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:39:09 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid 01162bf0-7e42-4926-95e3-a286827e16bf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:39:10 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Updating instance_info_cache with network_info: [{"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:39:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:39:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:39:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:39:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:10 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:39:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:39:11 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Creating image(s)
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Ensure instance console log exists: /opt/stack/data/nova/instances/8fde6d5f-cbc4-4108-9c2c-d86ae6587a03/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Start _get_guest_xml network_info=[{"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '30e73d9f-3c8b-44b4-8ca5-4400d315fad7', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBJncWFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8fde6d5f-cbc4-4108-9c2c-d86ae6587a03', 'attached_at': '', 'detached_at': '', 'volume_id': '68a9d689-8136-4eca-8e34-4125f727c3e1', 'serial': '68a9d689-8136-4eca-8e34-4125f727c3e1'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:39:11 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:39:11 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBJncWFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:39:11 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:39:11 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:39:11 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a474077-d53a-48e4-80fb-7ca3388f5ece]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:39:11 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdce271-9c76-4455-a32d-4864bfc40f33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1] added
Aug 17 21:39:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af8e0d3-009d-4f06-82e5-192679eac8f1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d1ff0a-49dd-41c5-887e-168da064e856]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBJncWFa {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBJncWFa" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a46a70-8bee-4c82-8b6c-72bd43366a98]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBJncWFa'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[17228703-1ccc-4d3c-bc99-965037d49643]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff9fe6e-5c46-4913-9487-7b9d4c61d2ce]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:39:11 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:39:11 user nova-compute[72818]:  {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:39:11 user nova-compute[72818]: WARNING os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 21:39:11 user nova-compute[72818]: 
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04d86ec-eac1-4c6b-a5b3-cd9702499220]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260]
Aug 17 21:39:11 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260] successful.
Aug 17 21:39:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[24712941-284e-4429-b6a8-eed42fda9df8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd08761d-bd11-41d0-87a8-b9c1bcd2cbfd]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:39:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:39:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[709047aa-cffe-4e33-bdbf-1de856f74825]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBJncWFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23861313266643065', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861313266643065', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:39:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:39:12 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8239MB free_disk=25.354602813720703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-675216932',display_name='tempest-TestVolumeBootPattern-server-675216932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-675216932',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvgvYY4VEzOO1hBWsb20sNrMVs8w/XTYHCJEm0Bvp0JOphCdpXxCT+2Vc1RBvadH4gKZoKMMxsPeL8omuqOhZEcjdNF9Xh2fVwAM7u4vOVW7jR4hyrsil3xbR7zmO8kpg==',key_name='tempest-TestVolumeBootPattern-782174029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-gdc0w8hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:39:01Z,user_data=None,user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=8fde6d5f-cbc4-4108-9c2c-d86ae6587a03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:1c:ec,bridge_name='br-int',has_traffic_filtering=True,id=36e2738b-21a2-4fa8-8298-e03350a6fc5c,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e2738b-21') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:39:12 user nova-compute[72818]:   <uuid>8fde6d5f-cbc4-4108-9c2c-d86ae6587a03</uuid>
Aug 17 21:39:12 user nova-compute[72818]:   <name>instance-00000029</name>
Aug 17 21:39:12 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:39:12 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:39:12 user nova-compute[72818]:   <metadata>
Aug 17 21:39:12 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:39:12 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:39:12 user nova-compute[72818]:       <nova:name>tempest-TestVolumeBootPattern-server-675216932</nova:name>
Aug 17 21:39:12 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:39:11</nova:creationTime>
Aug 17 21:39:12 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:39:12 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:39:12 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:39:12 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:39:12 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:39:12 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:39:12 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:39:12 user nova-compute[72818]:       <nova:owner>
Aug 17 21:39:12 user nova-compute[72818]:         <nova:user uuid="de902559a8794d1a8af9c0efbed4e38a">tempest-TestVolumeBootPattern-973058317-project-member</nova:user>
Aug 17 21:39:12 user nova-compute[72818]:         <nova:project uuid="92abc22a192a44398dffe75ffae6d270">tempest-TestVolumeBootPattern-973058317</nova:project>
Aug 17 21:39:12 user nova-compute[72818]:       </nova:owner>
Aug 17 21:39:12 user nova-compute[72818]:       <nova:ports>
Aug 17 21:39:12 user nova-compute[72818]:         <nova:port uuid="36e2738b-21a2-4fa8-8298-e03350a6fc5c">
Aug 17 21:39:12 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 21:39:12 user nova-compute[72818]:         </nova:port>
Aug 17 21:39:12 user nova-compute[72818]:       </nova:ports>
Aug 17 21:39:12 user nova-compute[72818]:     </nova:instance>
Aug 17 21:39:12 user nova-compute[72818]:   </metadata>
Aug 17 21:39:12 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:39:12 user nova-compute[72818]:     <system>
Aug 17 21:39:12 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:39:12 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:39:12 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:39:12 user nova-compute[72818]:       <entry name="serial">8fde6d5f-cbc4-4108-9c2c-d86ae6587a03</entry>
Aug 17 21:39:12 user nova-compute[72818]:       <entry name="uuid">8fde6d5f-cbc4-4108-9c2c-d86ae6587a03</entry>
Aug 17 21:39:12 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:39:12 user nova-compute[72818]:     </system>
Aug 17 21:39:12 user nova-compute[72818]:   </sysinfo>
Aug 17 21:39:12 user nova-compute[72818]:   <os>
Aug 17 21:39:12 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:39:12 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:39:12 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:39:12 user nova-compute[72818]:   </os>
Aug 17 21:39:12 user nova-compute[72818]:   <features>
Aug 17 21:39:12 user nova-compute[72818]:     <acpi/>
Aug 17 21:39:12 user nova-compute[72818]:     <apic/>
Aug 17 21:39:12 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:39:12 user nova-compute[72818]:   </features>
Aug 17 21:39:12 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:39:12 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:39:12 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:39:12 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:39:12 user nova-compute[72818]:   </clock>
Aug 17 21:39:12 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:39:12 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:39:12 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:39:12 user nova-compute[72818]:   </cpu>
Aug 17 21:39:12 user nova-compute[72818]:   <devices>
Aug 17 21:39:12 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:39:12 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:39:12 user nova-compute[72818]:       <source dev="/dev/sdb"/>
Aug 17 21:39:12 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:39:12 user nova-compute[72818]:       <serial>68a9d689-8136-4eca-8e34-4125f727c3e1</serial>
Aug 17 21:39:12 user nova-compute[72818]:     </disk>
Aug 17 21:39:12 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:39:12 user nova-compute[72818]:       <mac address="fa:16:3e:74:1c:ec"/>
Aug 17 21:39:12 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:39:12 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:39:12 user nova-compute[72818]:       <target dev="tap36e2738b-21"/>
Aug 17 21:39:12 user nova-compute[72818]:     </interface>
Aug 17 21:39:12 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:39:12 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/8fde6d5f-cbc4-4108-9c2c-d86ae6587a03/console.log" append="off"/>
Aug 17 21:39:12 user nova-compute[72818]:     </serial>
Aug 17 21:39:12 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:39:12 user nova-compute[72818]:     <video>
Aug 17 21:39:12 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:39:12 user nova-compute[72818]:     </video>
Aug 17 21:39:12 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:39:12 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:39:12 user nova-compute[72818]:     </rng>
Aug 17 21:39:12 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:39:12 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:39:12 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:39:12 user nova-compute[72818]:     </memballoon>
Aug 17 21:39:12 user nova-compute[72818]:   </devices>
Aug 17 21:39:12 user nova-compute[72818]: </domain>
Aug 17 21:39:12 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-675216932',display_name='tempest-TestVolumeBootPattern-server-675216932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-675216932',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvgvYY4VEzOO1hBWsb20sNrMVs8w/XTYHCJEm0Bvp0JOphCdpXxCT+2Vc1RBvadH4gKZoKMMxsPeL8omuqOhZEcjdNF9Xh2fVwAM7u4vOVW7jR4hyrsil3xbR7zmO8kpg==',key_name='tempest-TestVolumeBootPattern-782174029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-gdc0w8hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:39:01Z,user_data=None,user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=8fde6d5f-cbc4-4108-9c2c-d86ae6587a03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:1c:ec,bridge_name='br-int',has_traffic_filtering=True,id=36e2738b-21a2-4fa8-8298-e03350a6fc5c,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e2738b-21') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG os_vif [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:1c:ec,bridge_name='br-int',has_traffic_filtering=True,id=36e2738b-21a2-4fa8-8298-e03350a6fc5c,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e2738b-21') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36e2738b-21, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36e2738b-21, col_values=(('external_ids', {'iface-id': '36e2738b-21a2-4fa8-8298-e03350a6fc5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:1c:ec', 'vm-uuid': '8fde6d5f-cbc4-4108-9c2c-d86ae6587a03'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 01162bf0-7e42-4926-95e3-a286827e16bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 20c956c3-eeba-4e85-ac6b-f50e050ee098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 44c0f255-d86e-4799-99be-32f00b897a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:12 user nova-compute[72818]: INFO os_vif [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:1c:ec,bridge_name='br-int',has_traffic_filtering=True,id=36e2738b-21a2-4fa8-8298-e03350a6fc5c,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e2738b-21')
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] No VIF found with MAC fa:16:3e:74:1c:ec, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:39:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-29e5bc64-3d85-4451-ba7c-ed3c1e9d93fe req-b6e47d87-4b5f-4ea2-9e70-0813cb5f6111 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-29e5bc64-3d85-4451-ba7c-ed3c1e9d93fe req-b6e47d87-4b5f-4ea2-9e70-0813cb5f6111 service nova] Acquiring lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-29e5bc64-3d85-4451-ba7c-ed3c1e9d93fe req-b6e47d87-4b5f-4ea2-9e70-0813cb5f6111 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-29e5bc64-3d85-4451-ba7c-ed3c1e9d93fe req-b6e47d87-4b5f-4ea2-9e70-0813cb5f6111 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-29e5bc64-3d85-4451-ba7c-ed3c1e9d93fe req-b6e47d87-4b5f-4ea2-9e70-0813cb5f6111 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] No waiting events found dispatching network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:39:14 user nova-compute[72818]: WARNING nova.compute.manager [req-29e5bc64-3d85-4451-ba7c-ed3c1e9d93fe req-b6e47d87-4b5f-4ea2-9e70-0813cb5f6111 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received unexpected event network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c for instance with vm_state building and task_state spawning.
Aug 17 21:39:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:15 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308356.1769726, 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:39:16 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] VM Resumed (Lifecycle Event)
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:39:16 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Instance spawned successfully.
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:39:16 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308356.1782675, 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:39:16 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] VM Started (Lifecycle Event)
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:39:16 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:39:16 user nova-compute[72818]: INFO nova.compute.manager [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Took 5.27 seconds to spawn the instance on the hypervisor.
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:39:16 user nova-compute[72818]: INFO nova.compute.manager [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Took 16.21 seconds to build instance.
Aug 17 21:39:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b3ae3531-a65d-498e-8b32-b3ea5e0df302 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.338s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-68a490b6-af9a-40ad-b792-69197b37a4e3 req-459e039c-f8fe-443c-82f8-2c8c389f10dc service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-68a490b6-af9a-40ad-b792-69197b37a4e3 req-459e039c-f8fe-443c-82f8-2c8c389f10dc service nova] Acquiring lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-68a490b6-af9a-40ad-b792-69197b37a4e3 req-459e039c-f8fe-443c-82f8-2c8c389f10dc service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-68a490b6-af9a-40ad-b792-69197b37a4e3 req-459e039c-f8fe-443c-82f8-2c8c389f10dc service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-68a490b6-af9a-40ad-b792-69197b37a4e3 req-459e039c-f8fe-443c-82f8-2c8c389f10dc service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] No waiting events found dispatching network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:39:16 user nova-compute[72818]: WARNING nova.compute.manager [req-68a490b6-af9a-40ad-b792-69197b37a4e3 req-459e039c-f8fe-443c-82f8-2c8c389f10dc service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received unexpected event network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c for instance with vm_state active and task_state None.
Aug 17 21:39:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "284e9f53-7677-4f21-b998-759f1d151f9d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:22 user nova-compute[72818]: INFO nova.compute.manager [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Unshelving
Aug 17 21:39:22 user nova-compute[72818]: INFO nova.virt.block_device [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Booting with volume 3468f71e-713b-4080-8f5a-a048d1f515a7 at /dev/vdc
Aug 17 21:39:22 user nova-compute[72818]: DEBUG os_brick.utils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b35cb4-1da9-45cd-abb2-bc3072144061]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e1a2b6-f117-4752-94db-ff92580a279d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[af54b9f4-3bdf-45d2-8af1-a10d3b38315f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f82a6c-8de6-442d-bae0-5d3612b13d35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:39:22 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b7ceab-6486-43d4-8242-1a9deeb41c38]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG os_brick.utils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updating existing volume attachment record: 842567bc-563f-4717-9bed-f1b0c15105f7 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:39:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:33 user nova-compute[72818]: DEBUG nova.objects.instance [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'pci_requests' on Instance uuid 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:39:33 user nova-compute[72818]: DEBUG nova.objects.instance [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'numa_topology' on Instance uuid 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:39:33 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:39:33 user nova-compute[72818]: INFO nova.compute.claims [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Claim successful on node user
Aug 17 21:39:33 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:39:33 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:39:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:33 user nova-compute[72818]: INFO nova.network.neutron [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updating port 5b51c2ed-5dd4-461f-9c75-0ef59e66b00f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquired lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG nova.network.neutron [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-3b2bd4ad-dfdd-49f0-875b-6901761e14bb req-3c4885a1-fd9b-434c-8d8b-f4dc19ba0bf0 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-changed-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-3b2bd4ad-dfdd-49f0-875b-6901761e14bb req-3c4885a1-fd9b-434c-8d8b-f4dc19ba0bf0 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Refreshing instance network info cache due to event network-changed-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3b2bd4ad-dfdd-49f0-875b-6901761e14bb req-3c4885a1-fd9b-434c-8d8b-f4dc19ba0bf0 service nova] Acquiring lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG nova.network.neutron [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updating instance_info_cache with network_info: [{"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Releasing lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:39:34 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Creating image(s)
Aug 17 21:39:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "/opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "/opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "/opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG nova.objects.instance [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'trusted_certs' on Instance uuid 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3b2bd4ad-dfdd-49f0-875b-6901761e14bb req-3c4885a1-fd9b-434c-8d8b-f4dc19ba0bf0 service nova] Acquired lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG nova.network.neutron [req-3b2bd4ad-dfdd-49f0-875b-6901761e14bb req-3c4885a1-fd9b-434c-8d8b-f4dc19ba0bf0 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Refreshing network info cache for port 5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "d842fc4e3e893d16e93683f9572a74120b2ba108" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "d842fc4e3e893d16e93683f9572a74120b2ba108" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108.part --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:35 user nova-compute[72818]: DEBUG nova.compute.manager [req-f5b5e42c-a5eb-4e55-9c13-ac19a1e1a388 req-daa1e1b8-58b8-4465-8a9c-fb7ae748d985 service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Received event network-changed-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:39:35 user nova-compute[72818]: DEBUG nova.compute.manager [req-f5b5e42c-a5eb-4e55-9c13-ac19a1e1a388 req-daa1e1b8-58b8-4465-8a9c-fb7ae748d985 service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Refreshing instance network info cache due to event network-changed-f63bea4d-b5cf-4137-b058-4d3a0f0a2063. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:39:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f5b5e42c-a5eb-4e55-9c13-ac19a1e1a388 req-daa1e1b8-58b8-4465-8a9c-fb7ae748d985 service nova] Acquiring lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:39:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f5b5e42c-a5eb-4e55-9c13-ac19a1e1a388 req-daa1e1b8-58b8-4465-8a9c-fb7ae748d985 service nova] Acquired lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:39:35 user nova-compute[72818]: DEBUG nova.network.neutron [req-f5b5e42c-a5eb-4e55-9c13-ac19a1e1a388 req-daa1e1b8-58b8-4465-8a9c-fb7ae748d985 service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Refreshing network info cache for port f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:39:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108.part --force-share --output=json" returned: 0 in 0.194s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:35 user nova-compute[72818]: DEBUG nova.virt.images [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] 53f30d44-34b8-4350-843f-482a0628bd34 was qcow2, converting to raw {{(pid=72818) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 21:39:35 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:39:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108.part /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108.converted {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG nova.network.neutron [req-3b2bd4ad-dfdd-49f0-875b-6901761e14bb req-3c4885a1-fd9b-434c-8d8b-f4dc19ba0bf0 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updated VIF entry in instance network info cache for port 5b51c2ed-5dd4-461f-9c75-0ef59e66b00f. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG nova.network.neutron [req-3b2bd4ad-dfdd-49f0-875b-6901761e14bb req-3c4885a1-fd9b-434c-8d8b-f4dc19ba0bf0 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updating instance_info_cache with network_info: [{"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3b2bd4ad-dfdd-49f0-875b-6901761e14bb req-3c4885a1-fd9b-434c-8d8b-f4dc19ba0bf0 service nova] Releasing lock "refresh_cache-284e9f53-7677-4f21-b998-759f1d151f9d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG nova.network.neutron [req-f5b5e42c-a5eb-4e55-9c13-ac19a1e1a388 req-daa1e1b8-58b8-4465-8a9c-fb7ae748d985 service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Updated VIF entry in instance network info cache for port f63bea4d-b5cf-4137-b058-4d3a0f0a2063. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG nova.network.neutron [req-f5b5e42c-a5eb-4e55-9c13-ac19a1e1a388 req-daa1e1b8-58b8-4465-8a9c-fb7ae748d985 service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Updating instance_info_cache with network_info: [{"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f5b5e42c-a5eb-4e55-9c13-ac19a1e1a388 req-daa1e1b8-58b8-4465-8a9c-fb7ae748d985 service nova] Releasing lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108.part /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108.converted" returned: 0 in 0.573s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108.converted --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "d842fc4e3e893d16e93683f9572a74120b2ba108" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.135s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108 --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "d842fc4e3e893d16e93683f9572a74120b2ba108" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "d842fc4e3e893d16e93683f9572a74120b2ba108" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:36 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108 --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108,backing_fmt=raw /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108,backing_fmt=raw /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk 1073741824" returned: 0 in 0.052s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "d842fc4e3e893d16e93683f9572a74120b2ba108" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108 --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:37 user nova-compute[72818]: DEBUG nova.objects.instance [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'migration_context' on Instance uuid 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:39:37 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Rebasing disk image.
Aug 17 21:39:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 -F raw /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 -F raw /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk" returned: 0 in 2.498s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Ensure instance console log exists: /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Start _get_guest_xml network_info=[{"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='5e41a6b39ac649fd2ee2f6fcb1131603',container_format='bare',created_at=2023-08-17T21:37:29Z,direct_url=<?>,disk_format='qcow2',id=53f30d44-34b8-4350-843f-482a0628bd34,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1471917594-shelved',owner='4a9d9dc56ba84253be502280f64d7b59',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-17T21:37:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '842567bc-563f-4717-9bed-f1b0c15105f7', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkylWGLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '284e9f53-7677-4f21-b998-759f1d151f9d', 'attached_at': '', 'detached_at': '', 'volume_id': '3468f71e-713b-4080-8f5a-a048d1f515a7', 'serial': '3468f71e-713b-4080-8f5a-a048d1f515a7'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:39:40 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:39:40 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5e41a6b39ac649fd2ee2f6fcb1131603',container_format='bare',created_at=2023-08-17T21:37:29Z,direct_url=<?>,disk_format='qcow2',id=53f30d44-34b8-4350-843f-482a0628bd34,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1471917594-shelved',owner='4a9d9dc56ba84253be502280f64d7b59',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-17T21:37:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.objects.instance [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'vcpu_model' on Instance uuid 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkylWGLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:39:40 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:39:40 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:39:40 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a8ae59-6be1-4303-992d-ddc3facdeba0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:39:40 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0310f9-609d-4098-bade-e04ffe767540]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7] added
Aug 17 21:39:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[affd26eb-b2d6-497a-a5d8-6414788c22bf]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc54094-9916-466b-8226-14be94527599]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wkylWGLh {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "01162bf0-7e42-4926-95e3-a286827e16bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "01162bf0-7e42-4926-95e3-a286827e16bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wkylWGLh" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[297e80f7-e947-4215-9e64-f63989b76b05]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wkylWGLh'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.objects.instance [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'flavor' on Instance uuid 01162bf0-7e42-4926-95e3-a286827e16bf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b9ae45-1711-498f-8466-6e3db6ce28a4]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "01162bf0-7e42-4926-95e3-a286827e16bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4795335c-f41a-406c-aab0-2e0bf2158577]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:39:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:39:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a34eaa-c464-4e55-906f-db34f38b177e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7, portal: 172.16.0.220,3260]
Aug 17 21:39:40 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7, portal: 172.16.0.220,3260] successful.
Aug 17 21:39:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0db4679-0e61-4a4e-a137-a2e791454bff]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[daadc589-35d9-4ad7-965c-ed126962b815]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:39:40 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:39:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:39:40 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:39:40 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccffb1d-8647-4c8b-bafc-a213816fa1c4]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkylWGLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "01162bf0-7e42-4926-95e3-a286827e16bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "01162bf0-7e42-4926-95e3-a286827e16bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:40 user nova-compute[72818]: INFO nova.compute.manager [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Attaching volume 0c206b38-2e71-4181-9d7d-a8582c3ae81a to /dev/vdb
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.utils [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7c3954-5b35-4ec8-843d-9644a9138cb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd1a581-cfaa-4e6a-99d8-021e8fe59cdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf61d9a-3893-404d-b204-7f47003eacd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[440c7209-1c3b-43ca-83ab-992cf7037bf9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:39:40 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:39:40 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e93662-67de-4d4d-b2fc-b7a28e943e16]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG os_brick.utils [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:39:40 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Updating existing volume attachment record: 1d895e2c-3c31-4855-bc66-9b6314502761 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26633336265303365', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633336265303365', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1471917594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1471917594',id=35,image_ref='53f30d44-34b8-4350-843f-482a0628bd34',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-8619247',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:35:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4a9d9dc56ba84253be502280f64d7b59',ramdisk_id='',reservation_id='r-06vbaj3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-895220279',owner_user_name='tempest-AttachVolumeShelveTestJSON-895220279-project-member',shelved_at='2023-08-17T21:37:33.161785',shelved_host='user',shelved_image_id='53f30d44-34b8-4350-843f-482a0628bd34'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcc7e79679c4ebb915828988321acc8',uuid=284e9f53-7677-4f21-b998-759f1d151f9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converting VIF {"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG nova.objects.instance [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'pci_devices' on Instance uuid 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:39:41 user nova-compute[72818]:   <uuid>284e9f53-7677-4f21-b998-759f1d151f9d</uuid>
Aug 17 21:39:41 user nova-compute[72818]:   <name>instance-00000023</name>
Aug 17 21:39:41 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:39:41 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:39:41 user nova-compute[72818]:   <metadata>
Aug 17 21:39:41 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:39:41 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:39:41 user nova-compute[72818]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1471917594</nova:name>
Aug 17 21:39:41 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:39:40</nova:creationTime>
Aug 17 21:39:41 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:39:41 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:39:41 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:39:41 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:39:41 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:39:41 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:39:41 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:39:41 user nova-compute[72818]:       <nova:owner>
Aug 17 21:39:41 user nova-compute[72818]:         <nova:user uuid="fbcc7e79679c4ebb915828988321acc8">tempest-AttachVolumeShelveTestJSON-895220279-project-member</nova:user>
Aug 17 21:39:41 user nova-compute[72818]:         <nova:project uuid="4a9d9dc56ba84253be502280f64d7b59">tempest-AttachVolumeShelveTestJSON-895220279</nova:project>
Aug 17 21:39:41 user nova-compute[72818]:       </nova:owner>
Aug 17 21:39:41 user nova-compute[72818]:       <nova:root type="image" uuid="53f30d44-34b8-4350-843f-482a0628bd34"/>
Aug 17 21:39:41 user nova-compute[72818]:       <nova:ports>
Aug 17 21:39:41 user nova-compute[72818]:         <nova:port uuid="5b51c2ed-5dd4-461f-9c75-0ef59e66b00f">
Aug 17 21:39:41 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 21:39:41 user nova-compute[72818]:         </nova:port>
Aug 17 21:39:41 user nova-compute[72818]:       </nova:ports>
Aug 17 21:39:41 user nova-compute[72818]:     </nova:instance>
Aug 17 21:39:41 user nova-compute[72818]:   </metadata>
Aug 17 21:39:41 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:39:41 user nova-compute[72818]:     <system>
Aug 17 21:39:41 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:39:41 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:39:41 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:39:41 user nova-compute[72818]:       <entry name="serial">284e9f53-7677-4f21-b998-759f1d151f9d</entry>
Aug 17 21:39:41 user nova-compute[72818]:       <entry name="uuid">284e9f53-7677-4f21-b998-759f1d151f9d</entry>
Aug 17 21:39:41 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:39:41 user nova-compute[72818]:     </system>
Aug 17 21:39:41 user nova-compute[72818]:   </sysinfo>
Aug 17 21:39:41 user nova-compute[72818]:   <os>
Aug 17 21:39:41 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:39:41 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:39:41 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:39:41 user nova-compute[72818]:   </os>
Aug 17 21:39:41 user nova-compute[72818]:   <features>
Aug 17 21:39:41 user nova-compute[72818]:     <acpi/>
Aug 17 21:39:41 user nova-compute[72818]:     <apic/>
Aug 17 21:39:41 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:39:41 user nova-compute[72818]:   </features>
Aug 17 21:39:41 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:39:41 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:39:41 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:39:41 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:39:41 user nova-compute[72818]:   </clock>
Aug 17 21:39:41 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:39:41 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:39:41 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:39:41 user nova-compute[72818]:   </cpu>
Aug 17 21:39:41 user nova-compute[72818]:   <devices>
Aug 17 21:39:41 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:39:41 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:39:41 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk"/>
Aug 17 21:39:41 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:39:41 user nova-compute[72818]:     </disk>
Aug 17 21:39:41 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:39:41 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:39:41 user nova-compute[72818]:       <source dev="/dev/sdc"/>
Aug 17 21:39:41 user nova-compute[72818]:       <target dev="vdc" bus="virtio"/>
Aug 17 21:39:41 user nova-compute[72818]:       <serial>3468f71e-713b-4080-8f5a-a048d1f515a7</serial>
Aug 17 21:39:41 user nova-compute[72818]:     </disk>
Aug 17 21:39:41 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:39:41 user nova-compute[72818]:       <mac address="fa:16:3e:71:15:5a"/>
Aug 17 21:39:41 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:39:41 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:39:41 user nova-compute[72818]:       <target dev="tap5b51c2ed-5d"/>
Aug 17 21:39:41 user nova-compute[72818]:     </interface>
Aug 17 21:39:41 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:39:41 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/console.log" append="off"/>
Aug 17 21:39:41 user nova-compute[72818]:     </serial>
Aug 17 21:39:41 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:39:41 user nova-compute[72818]:     <video>
Aug 17 21:39:41 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:39:41 user nova-compute[72818]:     </video>
Aug 17 21:39:41 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:39:41 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:39:41 user nova-compute[72818]:     </rng>
Aug 17 21:39:41 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:39:41 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:39:41 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:39:41 user nova-compute[72818]:     </memballoon>
Aug 17 21:39:41 user nova-compute[72818]:   </devices>
Aug 17 21:39:41 user nova-compute[72818]: </domain>
Aug 17 21:39:41 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1471917594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1471917594',id=35,image_ref='53f30d44-34b8-4350-843f-482a0628bd34',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-8619247',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:35:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4a9d9dc56ba84253be502280f64d7b59',ramdisk_id='',reservation_id='r-06vbaj3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-895220279',owner_user_name='tempest-AttachVolumeShelveTestJSON-895220279-project-member',shelved_at='2023-08-17T21:37:33.161785',shelved_host='user',shelved_image_id='53f30d44-34b8-4350-843f-482a0628bd34'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcc7e79679c4ebb915828988321acc8',uuid=284e9f53-7677-4f21-b998-759f1d151f9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converting VIF {"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG os_vif [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b51c2ed-5d, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b51c2ed-5d, col_values=(('external_ids', {'iface-id': '5b51c2ed-5dd4-461f-9c75-0ef59e66b00f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:15:5a', 'vm-uuid': '284e9f53-7677-4f21-b998-759f1d151f9d'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:41 user nova-compute[72818]: INFO os_vif [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d')
Aug 17 21:39:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:39:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] No VIF found with MAC fa:16:3e:71:15:5a, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:39:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-d4268c9e-c9a5-441a-b404-f5e75aea2af7 req-5fff8c93-18d7-47d9-bc1a-b9a2705cbb55 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:39:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d4268c9e-c9a5-441a-b404-f5e75aea2af7 req-5fff8c93-18d7-47d9-bc1a-b9a2705cbb55 service nova] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d4268c9e-c9a5-441a-b404-f5e75aea2af7 req-5fff8c93-18d7-47d9-bc1a-b9a2705cbb55 service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d4268c9e-c9a5-441a-b404-f5e75aea2af7 req-5fff8c93-18d7-47d9-bc1a-b9a2705cbb55 service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-d4268c9e-c9a5-441a-b404-f5e75aea2af7 req-5fff8c93-18d7-47d9-bc1a-b9a2705cbb55 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] No waiting events found dispatching network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:39:43 user nova-compute[72818]: WARNING nova.compute.manager [req-d4268c9e-c9a5-441a-b404-f5e75aea2af7 req-5fff8c93-18d7-47d9-bc1a-b9a2705cbb55 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received unexpected event network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 21:39:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-f3a7291c-cf66-45de-9ae4-a7d9c8a3336d req-9654503c-48e4-4343-b01b-c0402270e348 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:39:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f3a7291c-cf66-45de-9ae4-a7d9c8a3336d req-9654503c-48e4-4343-b01b-c0402270e348 service nova] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f3a7291c-cf66-45de-9ae4-a7d9c8a3336d req-9654503c-48e4-4343-b01b-c0402270e348 service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f3a7291c-cf66-45de-9ae4-a7d9c8a3336d req-9654503c-48e4-4343-b01b-c0402270e348 service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-f3a7291c-cf66-45de-9ae4-a7d9c8a3336d req-9654503c-48e4-4343-b01b-c0402270e348 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] No waiting events found dispatching network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:39:45 user nova-compute[72818]: WARNING nova.compute.manager [req-f3a7291c-cf66-45de-9ae4-a7d9c8a3336d req-9654503c-48e4-4343-b01b-c0402270e348 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received unexpected event network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 21:39:45 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308385.335437, 284e9f53-7677-4f21-b998-759f1d151f9d => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:39:45 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] VM Resumed (Lifecycle Event)
Aug 17 21:39:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:39:45 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:39:45 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Instance spawned successfully.
Aug 17 21:39:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:39:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:39:45 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:39:45 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308385.3376384, 284e9f53-7677-4f21-b998-759f1d151f9d => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:39:45 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] VM Started (Lifecycle Event)
Aug 17 21:39:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:39:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:39:45 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:39:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:39:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-24e68b8e-9fc9-4ccc-bc00-9940670195f0 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "284e9f53-7677-4f21-b998-759f1d151f9d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.503s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujDWQLUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:39:52 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:39:52 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:39:52 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e09495-7011-4434-9ee5-3bf720340b93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:39:52 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cf6d19-d1ab-4922-a7bb-da85b0adc03f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a] added
Aug 17 21:39:52 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ade68b-1059-47f8-b380-51509ac2e6ea]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9157d5be-509d-4ffa-ad30-2c5effb0d868]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujDWQLUO {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujDWQLUO" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c5ba1-38a7-45fc-a82f-0b87fb3bbe1d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ujDWQLUO'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5e32d6-da2c-4930-9631-2f71a5c14bd9]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b53c9dd-811c-48ab-b570-33ed4f18cd81]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:39:52 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:39:52 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:39:52 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:39:52 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadb94da-dd44-442c-b739-69ebdc3d9074]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a, portal: 172.16.0.220,3260]
Aug 17 21:39:52 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a, portal: 172.16.0.220,3260] successful.
Aug 17 21:39:52 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c3e93c-c1e3-4e06-bc87-a6732cd43562]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[822ac92f-482d-4364-be36-37641fa13c39]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:39:52 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:39:52 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:39:52 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:39:52 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:39:52 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:39:52 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e99fa0-9fd9-448a-9b8e-15d0d8374258]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:39:52 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:39:53 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:39:53 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujDWQLUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:39:53 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:39:53 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23061643062333064', 'path': '/dev/sdd'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:39:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061643062333064', 'path': '/dev/sdd'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:39:53 user nova-compute[72818]: DEBUG nova.objects.instance [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'flavor' on Instance uuid 01162bf0-7e42-4926-95e3-a286827e16bf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:39:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:39:53 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:39:53 user nova-compute[72818]:   <source dev="/dev/sdd"/>
Aug 17 21:39:53 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:39:53 user nova-compute[72818]:   <serial>0c206b38-2e71-4181-9d7d-a8582c3ae81a</serial>
Aug 17 21:39:53 user nova-compute[72818]: </disk>
Aug 17 21:39:53 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:39:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:39:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:39:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No VIF found with MAC fa:16:3e:22:27:7a, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:39:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-22bac107-b16f-427f-971e-b906fe0aee46 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "01162bf0-7e42-4926-95e3-a286827e16bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.822s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:39:57 user nova-compute[72818]: INFO nova.compute.claims [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Claim successful on node user
Aug 17 21:39:57 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG nova.network.neutron [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:39:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:39:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG nova.policy [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d025fb1e3974f5d91a7086343bbe5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffd845455a84fbf9e1517ffe2af001c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:39:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Creating image(s)
Aug 17 21:39:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "/opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "/opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.201s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk 1073741824" returned: 0 in 0.056s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG nova.network.neutron [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Successfully created port: 79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Cannot resize image /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG nova.objects.instance [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'migration_context' on Instance uuid f1a55f21-4c94-4bcc-be12-5a0d8957fe41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Ensure instance console log exists: /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:39:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.network.neutron [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Successfully updated port: 79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "refresh_cache-f1a55f21-4c94-4bcc-be12-5a0d8957fe41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquired lock "refresh_cache-f1a55f21-4c94-4bcc-be12-5a0d8957fe41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.network.neutron [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-c00b112f-6a7c-45ce-9df5-51e984fa5f5b req-13bb4b86-38cb-4541-9404-54f55a5b872b service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Received event network-changed-79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-c00b112f-6a7c-45ce-9df5-51e984fa5f5b req-13bb4b86-38cb-4541-9404-54f55a5b872b service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Refreshing instance network info cache due to event network-changed-79d3c8d0-5356-4488-af4d-d896cd59ce6d. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c00b112f-6a7c-45ce-9df5-51e984fa5f5b req-13bb4b86-38cb-4541-9404-54f55a5b872b service nova] Acquiring lock "refresh_cache-f1a55f21-4c94-4bcc-be12-5a0d8957fe41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.network.neutron [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.network.neutron [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Updating instance_info_cache with network_info: [{"id": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "address": "fa:16:3e:0e:a0:d0", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d3c8d0-53", "ovs_interfaceid": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Releasing lock "refresh_cache-f1a55f21-4c94-4bcc-be12-5a0d8957fe41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Instance network_info: |[{"id": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "address": "fa:16:3e:0e:a0:d0", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d3c8d0-53", "ovs_interfaceid": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c00b112f-6a7c-45ce-9df5-51e984fa5f5b req-13bb4b86-38cb-4541-9404-54f55a5b872b service nova] Acquired lock "refresh_cache-f1a55f21-4c94-4bcc-be12-5a0d8957fe41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.network.neutron [req-c00b112f-6a7c-45ce-9df5-51e984fa5f5b req-13bb4b86-38cb-4541-9404-54f55a5b872b service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Refreshing network info cache for port 79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Start _get_guest_xml network_info=[{"id": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "address": "fa:16:3e:0e:a0:d0", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d3c8d0-53", "ovs_interfaceid": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:39:59 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:39:59 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:39:59 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1102178916',display_name='tempest-AttachVolumeNegativeTest-server-1102178916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1102178916',id=42,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSPJg58r7t3MIpzSlBte4+fr/fgPHwKjuXssKhldqB4AKuH0OxpIzRxjstXzNPkV+gFfg0hbBDqX+wVEl7SbjsqOpaeKdnQ0ULVzmOs2NEFr4K0J2KdLZg6iKqhmY91Lw==',key_name='tempest-keypair-2118014183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ffd845455a84fbf9e1517ffe2af001c',ramdisk_id='',reservation_id='r-icr5r7sx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2048664550',owner_user_name='tempest-AttachVolumeNegativeTest-2048664550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:39:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d025fb1e3974f5d91a7086343bbe5e1',uuid=f1a55f21-4c94-4bcc-be12-5a0d8957fe41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "address": "fa:16:3e:0e:a0:d0", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d3c8d0-53", "ovs_interfaceid": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converting VIF {"id": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "address": "fa:16:3e:0e:a0:d0", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d3c8d0-53", "ovs_interfaceid": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=79d3c8d0-5356-4488-af4d-d896cd59ce6d,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d3c8d0-53') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG nova.objects.instance [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'pci_devices' on Instance uuid f1a55f21-4c94-4bcc-be12-5a0d8957fe41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:40:00 user nova-compute[72818]:   <uuid>f1a55f21-4c94-4bcc-be12-5a0d8957fe41</uuid>
Aug 17 21:40:00 user nova-compute[72818]:   <name>instance-0000002a</name>
Aug 17 21:40:00 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:40:00 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:40:00 user nova-compute[72818]:   <metadata>
Aug 17 21:40:00 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:40:00 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:40:00 user nova-compute[72818]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1102178916</nova:name>
Aug 17 21:40:00 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:39:59</nova:creationTime>
Aug 17 21:40:00 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:40:00 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:40:00 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:40:00 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:40:00 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:40:00 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:40:00 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:40:00 user nova-compute[72818]:       <nova:owner>
Aug 17 21:40:00 user nova-compute[72818]:         <nova:user uuid="4d025fb1e3974f5d91a7086343bbe5e1">tempest-AttachVolumeNegativeTest-2048664550-project-member</nova:user>
Aug 17 21:40:00 user nova-compute[72818]:         <nova:project uuid="7ffd845455a84fbf9e1517ffe2af001c">tempest-AttachVolumeNegativeTest-2048664550</nova:project>
Aug 17 21:40:00 user nova-compute[72818]:       </nova:owner>
Aug 17 21:40:00 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:40:00 user nova-compute[72818]:       <nova:ports>
Aug 17 21:40:00 user nova-compute[72818]:         <nova:port uuid="79d3c8d0-5356-4488-af4d-d896cd59ce6d">
Aug 17 21:40:00 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 21:40:00 user nova-compute[72818]:         </nova:port>
Aug 17 21:40:00 user nova-compute[72818]:       </nova:ports>
Aug 17 21:40:00 user nova-compute[72818]:     </nova:instance>
Aug 17 21:40:00 user nova-compute[72818]:   </metadata>
Aug 17 21:40:00 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:40:00 user nova-compute[72818]:     <system>
Aug 17 21:40:00 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:40:00 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:40:00 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:40:00 user nova-compute[72818]:       <entry name="serial">f1a55f21-4c94-4bcc-be12-5a0d8957fe41</entry>
Aug 17 21:40:00 user nova-compute[72818]:       <entry name="uuid">f1a55f21-4c94-4bcc-be12-5a0d8957fe41</entry>
Aug 17 21:40:00 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:40:00 user nova-compute[72818]:     </system>
Aug 17 21:40:00 user nova-compute[72818]:   </sysinfo>
Aug 17 21:40:00 user nova-compute[72818]:   <os>
Aug 17 21:40:00 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:40:00 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:40:00 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:40:00 user nova-compute[72818]:   </os>
Aug 17 21:40:00 user nova-compute[72818]:   <features>
Aug 17 21:40:00 user nova-compute[72818]:     <acpi/>
Aug 17 21:40:00 user nova-compute[72818]:     <apic/>
Aug 17 21:40:00 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:40:00 user nova-compute[72818]:   </features>
Aug 17 21:40:00 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:40:00 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:40:00 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:40:00 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:40:00 user nova-compute[72818]:   </clock>
Aug 17 21:40:00 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:40:00 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:40:00 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:40:00 user nova-compute[72818]:   </cpu>
Aug 17 21:40:00 user nova-compute[72818]:   <devices>
Aug 17 21:40:00 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:40:00 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:40:00 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk"/>
Aug 17 21:40:00 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:40:00 user nova-compute[72818]:     </disk>
Aug 17 21:40:00 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:40:00 user nova-compute[72818]:       <mac address="fa:16:3e:0e:a0:d0"/>
Aug 17 21:40:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:40:00 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:40:00 user nova-compute[72818]:       <target dev="tap79d3c8d0-53"/>
Aug 17 21:40:00 user nova-compute[72818]:     </interface>
Aug 17 21:40:00 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:40:00 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/console.log" append="off"/>
Aug 17 21:40:00 user nova-compute[72818]:     </serial>
Aug 17 21:40:00 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:40:00 user nova-compute[72818]:     <video>
Aug 17 21:40:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:40:00 user nova-compute[72818]:     </video>
Aug 17 21:40:00 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:40:00 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:40:00 user nova-compute[72818]:     </rng>
Aug 17 21:40:00 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:40:00 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:40:00 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:40:00 user nova-compute[72818]:     </memballoon>
Aug 17 21:40:00 user nova-compute[72818]:   </devices>
Aug 17 21:40:00 user nova-compute[72818]: </domain>
Aug 17 21:40:00 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1102178916',display_name='tempest-AttachVolumeNegativeTest-server-1102178916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1102178916',id=42,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSPJg58r7t3MIpzSlBte4+fr/fgPHwKjuXssKhldqB4AKuH0OxpIzRxjstXzNPkV+gFfg0hbBDqX+wVEl7SbjsqOpaeKdnQ0ULVzmOs2NEFr4K0J2KdLZg6iKqhmY91Lw==',key_name='tempest-keypair-2118014183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ffd845455a84fbf9e1517ffe2af001c',ramdisk_id='',reservation_id='r-icr5r7sx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2048664550',owner_user_name='tempest-AttachVolumeNegativeTest-2048664550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:39:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d025fb1e3974f5d91a7086343bbe5e1',uuid=f1a55f21-4c94-4bcc-be12-5a0d8957fe41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "address": "fa:16:3e:0e:a0:d0", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d3c8d0-53", "ovs_interfaceid": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converting VIF {"id": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "address": "fa:16:3e:0e:a0:d0", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d3c8d0-53", "ovs_interfaceid": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=79d3c8d0-5356-4488-af4d-d896cd59ce6d,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d3c8d0-53') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG os_vif [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=79d3c8d0-5356-4488-af4d-d896cd59ce6d,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d3c8d0-53') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79d3c8d0-53, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79d3c8d0-53, col_values=(('external_ids', {'iface-id': '79d3c8d0-5356-4488-af4d-d896cd59ce6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:a0:d0', 'vm-uuid': 'f1a55f21-4c94-4bcc-be12-5a0d8957fe41'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:00 user nova-compute[72818]: INFO os_vif [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=79d3c8d0-5356-4488-af4d-d896cd59ce6d,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d3c8d0-53')
Aug 17 21:40:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No VIF found with MAC fa:16:3e:0e:a0:d0, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG nova.network.neutron [req-c00b112f-6a7c-45ce-9df5-51e984fa5f5b req-13bb4b86-38cb-4541-9404-54f55a5b872b service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Updated VIF entry in instance network info cache for port 79d3c8d0-5356-4488-af4d-d896cd59ce6d. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG nova.network.neutron [req-c00b112f-6a7c-45ce-9df5-51e984fa5f5b req-13bb4b86-38cb-4541-9404-54f55a5b872b service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Updating instance_info_cache with network_info: [{"id": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "address": "fa:16:3e:0e:a0:d0", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d3c8d0-53", "ovs_interfaceid": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:40:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c00b112f-6a7c-45ce-9df5-51e984fa5f5b req-13bb4b86-38cb-4541-9404-54f55a5b872b service nova] Releasing lock "refresh_cache-f1a55f21-4c94-4bcc-be12-5a0d8957fe41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:40:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-6c01d7dd-64d8-434a-a3e4-ccf94aed1e77 req-b442b470-9801-4132-b1dc-addcb2c7cdd0 service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Received event network-vif-plugged-79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:40:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c01d7dd-64d8-434a-a3e4-ccf94aed1e77 req-b442b470-9801-4132-b1dc-addcb2c7cdd0 service nova] Acquiring lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c01d7dd-64d8-434a-a3e4-ccf94aed1e77 req-b442b470-9801-4132-b1dc-addcb2c7cdd0 service nova] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6c01d7dd-64d8-434a-a3e4-ccf94aed1e77 req-b442b470-9801-4132-b1dc-addcb2c7cdd0 service nova] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-6c01d7dd-64d8-434a-a3e4-ccf94aed1e77 req-b442b470-9801-4132-b1dc-addcb2c7cdd0 service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] No waiting events found dispatching network-vif-plugged-79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:40:01 user nova-compute[72818]: WARNING nova.compute.manager [req-6c01d7dd-64d8-434a-a3e4-ccf94aed1e77 req-b442b470-9801-4132-b1dc-addcb2c7cdd0 service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Received unexpected event network-vif-plugged-79d3c8d0-5356-4488-af4d-d896cd59ce6d for instance with vm_state building and task_state spawning.
Aug 17 21:40:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-f4e90936-7c93-4432-94a1-9ab9e4c9f539 req-2176401f-cf06-4df8-a4e1-51a202a1e2db service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Received event network-vif-plugged-79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f4e90936-7c93-4432-94a1-9ab9e4c9f539 req-2176401f-cf06-4df8-a4e1-51a202a1e2db service nova] Acquiring lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f4e90936-7c93-4432-94a1-9ab9e4c9f539 req-2176401f-cf06-4df8-a4e1-51a202a1e2db service nova] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f4e90936-7c93-4432-94a1-9ab9e4c9f539 req-2176401f-cf06-4df8-a4e1-51a202a1e2db service nova] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-f4e90936-7c93-4432-94a1-9ab9e4c9f539 req-2176401f-cf06-4df8-a4e1-51a202a1e2db service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] No waiting events found dispatching network-vif-plugged-79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:40:03 user nova-compute[72818]: WARNING nova.compute.manager [req-f4e90936-7c93-4432-94a1-9ab9e4c9f539 req-2176401f-cf06-4df8-a4e1-51a202a1e2db service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Received unexpected event network-vif-plugged-79d3c8d0-5356-4488-af4d-d896cd59ce6d for instance with vm_state building and task_state spawning.
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308403.8859367, f1a55f21-4c94-4bcc-be12-5a0d8957fe41 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:40:03 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] VM Resumed (Lifecycle Event)
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:40:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Instance spawned successfully.
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:40:03 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308403.8892014, f1a55f21-4c94-4bcc-be12-5a0d8957fe41 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:40:03 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] VM Started (Lifecycle Event)
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:40:03 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:40:03 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:40:04 user nova-compute[72818]: INFO nova.compute.manager [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 17 21:40:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:40:04 user nova-compute[72818]: INFO nova.compute.manager [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Took 6.77 seconds to build instance.
Aug 17 21:40:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c8cf7639-f7f0-4152-ab23-9c0ec5d6b785 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.864s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:40:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:07 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:40:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:40:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:40:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:40:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-20c956c3-eeba-4e85-ac6b-f50e050ee098" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:40:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-20c956c3-eeba-4e85-ac6b-f50e050ee098" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:40:10 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:40:11 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Updating instance_info_cache with network_info: [{"id": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "address": "fa:16:3e:17:cd:d5", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67fc5332-84", "ovs_interfaceid": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:40:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-20c956c3-eeba-4e85-ac6b-f50e050ee098" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:40:11 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:40:11 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:40:11 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:40:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:11 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:40:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:12 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:40:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:40:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:40:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:14 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:40:14 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:40:14 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7982MB free_disk=25.31667709350586GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 01162bf0-7e42-4926-95e3-a286827e16bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 20c956c3-eeba-4e85-ac6b-f50e050ee098 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 44c0f255-d86e-4799-99be-32f00b897a17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 284e9f53-7677-4f21-b998-759f1d151f9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance f1a55f21-4c94-4bcc-be12-5a0d8957fe41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:40:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:15 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:40:15 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:40:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:40:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:17 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:40:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "20c956c3-eeba-4e85-ac6b-f50e050ee098" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:25 user nova-compute[72818]: INFO nova.compute.manager [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Terminating instance
Aug 17 21:40:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG nova.compute.manager [req-38d7b37e-b84c-441e-aa23-3ad8a33cbf51 req-439e8f0d-1acc-4edd-8273-cbf495dc1fde service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Received event network-vif-unplugged-67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-38d7b37e-b84c-441e-aa23-3ad8a33cbf51 req-439e8f0d-1acc-4edd-8273-cbf495dc1fde service nova] Acquiring lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-38d7b37e-b84c-441e-aa23-3ad8a33cbf51 req-439e8f0d-1acc-4edd-8273-cbf495dc1fde service nova] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-38d7b37e-b84c-441e-aa23-3ad8a33cbf51 req-439e8f0d-1acc-4edd-8273-cbf495dc1fde service nova] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG nova.compute.manager [req-38d7b37e-b84c-441e-aa23-3ad8a33cbf51 req-439e8f0d-1acc-4edd-8273-cbf495dc1fde service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] No waiting events found dispatching network-vif-unplugged-67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG nova.compute.manager [req-38d7b37e-b84c-441e-aa23-3ad8a33cbf51 req-439e8f0d-1acc-4edd-8273-cbf495dc1fde service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Received event network-vif-unplugged-67fc5332-848f-4511-9b1a-4faa3c21d35d for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:40:25 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Instance destroyed successfully.
Aug 17 21:40:25 user nova-compute[72818]: DEBUG nova.objects.instance [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lazy-loading 'resources' on Instance uuid 20c956c3-eeba-4e85-ac6b-f50e050ee098 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1399178584',display_name='tempest-VolumesActionsTest-instance-1399178584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1399178584',id=39,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:38:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='371d253c57734dcfacd1e7e37116258d',ramdisk_id='',reservation_id='r-5s2z9b0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-485654311',owner_user_name='tempest-VolumesActionsTest-485654311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:38:41Z,user_data=None,user_id='c6934fedf4fb46a4b9e1495aa20a6111',uuid=20c956c3-eeba-4e85-ac6b-f50e050ee098,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "address": "fa:16:3e:17:cd:d5", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67fc5332-84", "ovs_interfaceid": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Converting VIF {"id": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "address": "fa:16:3e:17:cd:d5", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67fc5332-84", "ovs_interfaceid": "67fc5332-848f-4511-9b1a-4faa3c21d35d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:cd:d5,bridge_name='br-int',has_traffic_filtering=True,id=67fc5332-848f-4511-9b1a-4faa3c21d35d,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67fc5332-84') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG os_vif [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:cd:d5,bridge_name='br-int',has_traffic_filtering=True,id=67fc5332-848f-4511-9b1a-4faa3c21d35d,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67fc5332-84') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67fc5332-84, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:40:25 user nova-compute[72818]: INFO os_vif [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:cd:d5,bridge_name='br-int',has_traffic_filtering=True,id=67fc5332-848f-4511-9b1a-4faa3c21d35d,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67fc5332-84')
Aug 17 21:40:25 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Deleting instance files /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098_del
Aug 17 21:40:25 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Deletion of /opt/stack/data/nova/instances/20c956c3-eeba-4e85-ac6b-f50e050ee098_del complete
Aug 17 21:40:25 user nova-compute[72818]: INFO nova.compute.manager [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 21:40:25 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:40:25 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:40:26 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:40:26 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Took 0.59 seconds to deallocate network for instance.
Aug 17 21:40:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-560e3299-5a54-49fb-8e5a-cc1d65557476 req-c6878e9d-40cf-4d07-8a20-280246bf51db service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Received event network-vif-deleted-67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:40:26 user nova-compute[72818]: INFO nova.compute.manager [req-560e3299-5a54-49fb-8e5a-cc1d65557476 req-c6878e9d-40cf-4d07-8a20-280246bf51db service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Neutron deleted interface 67fc5332-848f-4511-9b1a-4faa3c21d35d; detaching it from the instance and deleting it from the info cache
Aug 17 21:40:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-560e3299-5a54-49fb-8e5a-cc1d65557476 req-c6878e9d-40cf-4d07-8a20-280246bf51db service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:40:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-560e3299-5a54-49fb-8e5a-cc1d65557476 req-c6878e9d-40cf-4d07-8a20-280246bf51db service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Detach interface failed, port_id=67fc5332-848f-4511-9b1a-4faa3c21d35d, reason: Instance 20c956c3-eeba-4e85-ac6b-f50e050ee098 could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:40:26 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:40:26 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:40:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:26 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Deleted allocations for instance 20c956c3-eeba-4e85-ac6b-f50e050ee098
Aug 17 21:40:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-6cbbee33-dcb5-48f7-ba07-fb0630e6466f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.882s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:27 user nova-compute[72818]: DEBUG nova.compute.manager [req-4efc154e-682d-4116-8c40-06f2fd7e7c45 req-bcd7dd69-9467-4cac-bec5-a099a54b4069 service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Received event network-vif-plugged-67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:40:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4efc154e-682d-4116-8c40-06f2fd7e7c45 req-bcd7dd69-9467-4cac-bec5-a099a54b4069 service nova] Acquiring lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4efc154e-682d-4116-8c40-06f2fd7e7c45 req-bcd7dd69-9467-4cac-bec5-a099a54b4069 service nova] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4efc154e-682d-4116-8c40-06f2fd7e7c45 req-bcd7dd69-9467-4cac-bec5-a099a54b4069 service nova] Lock "20c956c3-eeba-4e85-ac6b-f50e050ee098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:27 user nova-compute[72818]: DEBUG nova.compute.manager [req-4efc154e-682d-4116-8c40-06f2fd7e7c45 req-bcd7dd69-9467-4cac-bec5-a099a54b4069 service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] No waiting events found dispatching network-vif-plugged-67fc5332-848f-4511-9b1a-4faa3c21d35d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:40:27 user nova-compute[72818]: WARNING nova.compute.manager [req-4efc154e-682d-4116-8c40-06f2fd7e7c45 req-bcd7dd69-9467-4cac-bec5-a099a54b4069 service nova] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Received unexpected event network-vif-plugged-67fc5332-848f-4511-9b1a-4faa3c21d35d for instance with vm_state deleted and task_state None.
Aug 17 21:40:29 user nova-compute[72818]: DEBUG nova.compute.manager [req-8ba1feac-592a-45aa-853c-17b9b27723eb req-2e92bbc7-f2f0-4f0d-934c-987759c9e5d5 service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Received event network-changed-a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:40:29 user nova-compute[72818]: DEBUG nova.compute.manager [req-8ba1feac-592a-45aa-853c-17b9b27723eb req-2e92bbc7-f2f0-4f0d-934c-987759c9e5d5 service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Refreshing instance network info cache due to event network-changed-a0f3842b-4aa7-4921-abd1-07a633536d86. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:40:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8ba1feac-592a-45aa-853c-17b9b27723eb req-2e92bbc7-f2f0-4f0d-934c-987759c9e5d5 service nova] Acquiring lock "refresh_cache-44c0f255-d86e-4799-99be-32f00b897a17" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:40:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8ba1feac-592a-45aa-853c-17b9b27723eb req-2e92bbc7-f2f0-4f0d-934c-987759c9e5d5 service nova] Acquired lock "refresh_cache-44c0f255-d86e-4799-99be-32f00b897a17" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:40:29 user nova-compute[72818]: DEBUG nova.network.neutron [req-8ba1feac-592a-45aa-853c-17b9b27723eb req-2e92bbc7-f2f0-4f0d-934c-987759c9e5d5 service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Refreshing network info cache for port a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:40:29 user nova-compute[72818]: DEBUG nova.network.neutron [req-8ba1feac-592a-45aa-853c-17b9b27723eb req-2e92bbc7-f2f0-4f0d-934c-987759c9e5d5 service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Updated VIF entry in instance network info cache for port a0f3842b-4aa7-4921-abd1-07a633536d86. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:40:29 user nova-compute[72818]: DEBUG nova.network.neutron [req-8ba1feac-592a-45aa-853c-17b9b27723eb req-2e92bbc7-f2f0-4f0d-934c-987759c9e5d5 service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Updating instance_info_cache with network_info: [{"id": "a0f3842b-4aa7-4921-abd1-07a633536d86", "address": "fa:16:3e:24:48:82", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f3842b-4a", "ovs_interfaceid": "a0f3842b-4aa7-4921-abd1-07a633536d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:40:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8ba1feac-592a-45aa-853c-17b9b27723eb req-2e92bbc7-f2f0-4f0d-934c-987759c9e5d5 service nova] Releasing lock "refresh_cache-44c0f255-d86e-4799-99be-32f00b897a17" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:40:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:33 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid 44c0f255-d86e-4799-99be-32f00b897a17 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:40:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:33 user nova-compute[72818]: INFO nova.compute.manager [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Attaching volume c22cef61-7690-49ef-9e16-afeb9948a240 to /dev/vdb
Aug 17 21:40:34 user nova-compute[72818]: DEBUG os_brick.utils [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5476528b-6666-41b2-8bb8-22f450432943]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc900bd3-e551-460f-bb3a-a64594abfc7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14c6e0f-af82-44d6-9ff6-e77c7e30ff13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a823775-5760-41f0-a5ec-75c9ebfd6889]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:40:34 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:40:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f4dfef-2fe9-468c-8f17-200534d58f64]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG os_brick.utils [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:40:34 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Updating existing volume attachment record: ebbf5af4-853b-436e-818e-75b2d765b526 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:40:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:40 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308425.8312793, 20c956c3-eeba-4e85-ac6b-f50e050ee098 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:40:40 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] VM Stopped (Lifecycle Event)
Aug 17 21:40:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-da39c349-2100-4e06-b316-deddaf668567 None None] [instance: 20c956c3-eeba-4e85-ac6b-f50e050ee098] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:40:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmMznvTA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:40:45 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:40:45 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:40:45 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[284ed67c-be87-41e6-a76d-a91faa565f25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:40:45 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[25297464-52a4-492f-8c8b-cec278e863c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240] added
Aug 17 21:40:45 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ac8aea-afb5-4a82-94f7-f154b6fe23e7]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7dfabb-a467-407f-a423-c999bf8d0c0f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmMznvTA {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmMznvTA" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8681b1-8a8a-40b8-9194-2d486cd7bdeb]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NmMznvTA'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f16df61-d4ba-48eb-b7c8-179e203d1890]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc21cf2f-4e4d-42d1-96b1-4b8c02c59b0a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:40:45 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:40:45 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:40:45 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:40:45 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:40:45 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:40:45 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac71e9a4-b5bb-4592-b446-5f803afd1bb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240, portal: 172.16.0.220,3260]
Aug 17 21:40:45 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240, portal: 172.16.0.220,3260] successful.
Aug 17 21:40:45 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[814f4340-fff9-4ba6-bfda-0baf7b5388f1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bae38d-cc7f-4500-9be4-973424086208]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:40:45 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:40:45 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:40:45 user nova-compute[72818]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 (non-flash)
Aug 17 21:40:45 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:40:45 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:40:45 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:40:45 user nova-compute[72818]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 (non-flash)
Aug 17 21:40:45 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4274d51e-9f18-43b8-afac-de27c5ca6c6f]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:40:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:46 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:40:46 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmMznvTA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:40:46 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:40:46 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26438356361373363', 'path': '/dev/sde'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:40:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438356361373363', 'path': '/dev/sde'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:40:46 user nova-compute[72818]: DEBUG nova.objects.instance [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid 44c0f255-d86e-4799-99be-32f00b897a17 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:40:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:40:46 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:40:46 user nova-compute[72818]:   <source dev="/dev/sde"/>
Aug 17 21:40:46 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:40:46 user nova-compute[72818]:   <serial>c22cef61-7690-49ef-9e16-afeb9948a240</serial>
Aug 17 21:40:46 user nova-compute[72818]: </disk>
Aug 17 21:40:46 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:40:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:40:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:40:46 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No VIF found with MAC fa:16:3e:24:48:82, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:40:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-7a7ab64f-8f26-4053-9ed8-87b72b74044e tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.188s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:51 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid 44c0f255-d86e-4799-99be-32f00b897a17 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:40:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:40:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:40:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:40:51 user nova-compute[72818]: INFO nova.compute.manager [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Attaching volume 78f78863-e13d-4837-bd4d-e57b4d1706f9 to /dev/vdc
Aug 17 21:40:52 user nova-compute[72818]: DEBUG os_brick.utils [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7798646e-f41d-416a-9dd6-667043b0ecfe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d20eac5-4603-427d-b817-db11f108007a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff11125-f6c1-4822-b7dc-262a2e4e53b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[730d2812-e76e-43f9-9ce5-74c68b647feb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:40:52 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:40:52 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5066a177-5f19-416e-80d4-1f01e9314ad4]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG os_brick.utils [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:40:52 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Updating existing volume attachment record: 2bd761f5-4307-4ab5-b087-b86796554d8c {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:40:53 user nova-compute[72818]: DEBUG nova.compute.manager [req-8d2f6dda-4a43-4204-9516-cc394ffd1d08 req-0b5f069b-12d5-4d49-8efb-f0596b4ceb75 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-changed-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:40:53 user nova-compute[72818]: DEBUG nova.compute.manager [req-8d2f6dda-4a43-4204-9516-cc394ffd1d08 req-0b5f069b-12d5-4d49-8efb-f0596b4ceb75 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Refreshing instance network info cache due to event network-changed-36e2738b-21a2-4fa8-8298-e03350a6fc5c. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:40:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8d2f6dda-4a43-4204-9516-cc394ffd1d08 req-0b5f069b-12d5-4d49-8efb-f0596b4ceb75 service nova] Acquiring lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:40:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8d2f6dda-4a43-4204-9516-cc394ffd1d08 req-0b5f069b-12d5-4d49-8efb-f0596b4ceb75 service nova] Acquired lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:40:53 user nova-compute[72818]: DEBUG nova.network.neutron [req-8d2f6dda-4a43-4204-9516-cc394ffd1d08 req-0b5f069b-12d5-4d49-8efb-f0596b4ceb75 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Refreshing network info cache for port 36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:40:54 user nova-compute[72818]: DEBUG nova.network.neutron [req-8d2f6dda-4a43-4204-9516-cc394ffd1d08 req-0b5f069b-12d5-4d49-8efb-f0596b4ceb75 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Updated VIF entry in instance network info cache for port 36e2738b-21a2-4fa8-8298-e03350a6fc5c. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:40:54 user nova-compute[72818]: DEBUG nova.network.neutron [req-8d2f6dda-4a43-4204-9516-cc394ffd1d08 req-0b5f069b-12d5-4d49-8efb-f0596b4ceb75 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Updating instance_info_cache with network_info: [{"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:40:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8d2f6dda-4a43-4204-9516-cc394ffd1d08 req-0b5f069b-12d5-4d49-8efb-f0596b4ceb75 service nova] Releasing lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:40:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:40:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TnpSyAPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:41:03 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:41:03 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:41:03 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77ca11d-e9ec-4a72-895b-bfa0f31342e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:41:03 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e0d519-9c45-4c2c-a6d9-d7984e61c601]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9] added
Aug 17 21:41:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85b98c9-6259-4d2f-9371-308bcb52e135]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c9edd8-4d12-426f-88d0-1a6d9d53bb2f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TnpSyAPK {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TnpSyAPK" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe504609-d08f-460c-8db1-8923adad204c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TnpSyAPK'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[745ad4df-65e5-4087-8843-ce08949ff55e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cd112c-83fb-4e0e-9281-3b05b18d9f8b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[670ad3f9-e6fe-457b-97e6-5a40b55e8426]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9, portal: 172.16.0.220,3260]
Aug 17 21:41:03 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9, portal: 172.16.0.220,3260] successful.
Aug 17 21:41:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[517d8133-d333-44ac-90cd-859c996874da]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a9339e-ba25-43c6-917a-6d5affa2d4e2]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 (non-flash)
Aug 17 21:41:03 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:41:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[278a7010-72df-4039-a0aa-b7441b9fc89c]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:04 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:41:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TnpSyAPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:41:04 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:41:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26537393665343539', 'path': '/dev/sdf'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:41:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537393665343539', 'path': '/dev/sdf'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:41:05 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid 44c0f255-d86e-4799-99be-32f00b897a17 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:41:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:41:05 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:41:05 user nova-compute[72818]:   <source dev="/dev/sdf"/>
Aug 17 21:41:05 user nova-compute[72818]:   <target dev="vdc" bus="virtio"/>
Aug 17 21:41:05 user nova-compute[72818]:   <serial>78f78863-e13d-4837-bd4d-e57b4d1706f9</serial>
Aug 17 21:41:05 user nova-compute[72818]: </disk>
Aug 17 21:41:05 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:41:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:41:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:41:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:41:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] No VIF found with MAC fa:16:3e:24:48:82, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:41:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d62105e5-0c50-4934-a66a-a17c99910aea tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.723s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:06 user nova-compute[72818]: INFO nova.compute.manager [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Detaching volume c22cef61-7690-49ef-9e16-afeb9948a240
Aug 17 21:41:06 user nova-compute[72818]: INFO nova.virt.block_device [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Attempting to driver detach volume c22cef61-7690-49ef-9e16-afeb9948a240 from mountpoint /dev/vdb
Aug 17 21:41:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Attempting to detach device vdb from instance 44c0f255-d86e-4799-99be-32f00b897a17 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:41:06 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:41:06 user nova-compute[72818]:   <source dev="/dev/sde"/>
Aug 17 21:41:06 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:41:06 user nova-compute[72818]:   <serial>c22cef61-7690-49ef-9e16-afeb9948a240</serial>
Aug 17 21:41:06 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:41:06 user nova-compute[72818]: </disk>
Aug 17 21:41:06 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:41:06 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully detached device vdb from instance 44c0f255-d86e-4799-99be-32f00b897a17 from the persistent domain config.
Aug 17 21:41:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44c0f255-d86e-4799-99be-32f00b897a17 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:41:06 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:41:06 user nova-compute[72818]:   <source dev="/dev/sde"/>
Aug 17 21:41:06 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:41:06 user nova-compute[72818]:   <serial>c22cef61-7690-49ef-9e16-afeb9948a240</serial>
Aug 17 21:41:06 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:41:06 user nova-compute[72818]: </disk>
Aug 17 21:41:06 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308466.8414245, 44c0f255-d86e-4799-99be-32f00b897a17 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44c0f255-d86e-4799-99be-32f00b897a17 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:41:06 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully detached device vdb from instance 44c0f255-d86e-4799-99be-32f00b897a17 from the live domain config.
Aug 17 21:41:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmMznvTA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:41:06 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:41:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8b5079-52af-43cc-a49e-ea7b6ab1b0ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d7cf28-080d-48c1-999a-2e89b2f254ce]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:06 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:41:06 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:06 user nova-compute[72818]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 (non-flash)
Aug 17 21:41:06 user nova-compute[72818]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 (non-flash)
Aug 17 21:41:06 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:06 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:41:06 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:06 user nova-compute[72818]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 (non-flash)
Aug 17 21:41:06 user nova-compute[72818]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 (non-flash)
Aug 17 21:41:06 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04e64dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240'): ({'sde'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Removing single pathed devices sde {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e9d123-c547-4450-b246-3b489229ef7f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3a76cc-7b62-4b52-bd12-e18939975d1d]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Flushing IO for device /dev/sde {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG nova.compute.manager [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e1aad9-34ed-4ee7-9ba3-68f5e6c4dd94]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:41:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b767a5-500e-4247-a062-e452043505bf]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] SCSI volumes sde have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c253e6b-6ad2-4ed0-9d28-c2c914b0f822]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:41:07 user nova-compute[72818]: INFO nova.compute.claims [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Claim successful on node user
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[006e9746-91e5-41be-baa9-b14a72fa4954]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240, portal: 172.16.0.220,3260]
Aug 17 21:41:07 user nova-compute[72818]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240, portal: 172.16.0.220,3260] successful.
Aug 17 21:41:07 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22cef61-7690-49ef-9e16-afeb9948a240 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbab7d7d-e4cc-4695-ac4d-51d5ae2510eb]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] <== disconnect_volume: return (312ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "68b338a7-f643-4635-b2af-d4170504589d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "68b338a7-f643-4635-b2af-d4170504589d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.170s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:41:07 user nova-compute[72818]: INFO nova.compute.claims [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Claim successful on node user
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.network.neutron [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:41:07 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.policy [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '214fa313bcc84892928f43a023ab2b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d01ed6842244a2f88a95aa8a29f7eae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:41:07 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Creating image(s)
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "/opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "/opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.network.neutron [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:41:07 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:41:07 user nova-compute[72818]: DEBUG nova.objects.instance [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid 44c0f255-d86e-4799-99be-32f00b897a17 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-1feab9a7-63a7-4fd2-bcf0-67fd2ca5318c tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.736s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:08 user nova-compute[72818]: INFO nova.virt.block_device [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Booting with volume 0806a3b7-8b6b-4157-827f-7fa2ae255397 at /dev/vda
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.policy [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de902559a8794d1a8af9c0efbed4e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92abc22a192a44398dffe75ffae6d270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG os_brick.utils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk 1073741824" returned: 0 in 0.056s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2032eca8-7994-4677-8d53-5d467f155378]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e28cb6a-a3b0-43b7-b92e-e4aa57c92f63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca1a9c4-6470-4d9b-8863-f26dbf80c764]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[13001b5a-bf00-417b-b1c8-49e6f176fbba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:41:08 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af75f9c-25d6-4343-af56-34ed901e93d7]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG os_brick.utils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Updating existing volume attachment record: d8a27900-0d78-44b9-baec-6552c991433a {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Successfully created port: bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Cannot resize image /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.objects.instance [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'migration_context' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Ensure instance console log exists: /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:08 user nova-compute[72818]: INFO nova.compute.manager [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Detaching volume 78f78863-e13d-4837-bd4d-e57b4d1706f9
Aug 17 21:41:08 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:08 user nova-compute[72818]: INFO nova.virt.block_device [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Attempting to driver detach volume 78f78863-e13d-4837-bd4d-e57b4d1706f9 from mountpoint /dev/vdc
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Successfully created port: b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Attempting to detach device vdc from instance 44c0f255-d86e-4799-99be-32f00b897a17 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:41:08 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:41:08 user nova-compute[72818]:   <source dev="/dev/sdf"/>
Aug 17 21:41:08 user nova-compute[72818]:   <target dev="vdc" bus="virtio"/>
Aug 17 21:41:08 user nova-compute[72818]:   <serial>78f78863-e13d-4837-bd4d-e57b4d1706f9</serial>
Aug 17 21:41:08 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 21:41:08 user nova-compute[72818]: </disk>
Aug 17 21:41:08 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:41:08 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully detached device vdc from instance 44c0f255-d86e-4799-99be-32f00b897a17 from the persistent domain config.
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 44c0f255-d86e-4799-99be-32f00b897a17 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:41:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:41:08 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:41:08 user nova-compute[72818]:   <source dev="/dev/sdf"/>
Aug 17 21:41:08 user nova-compute[72818]:   <target dev="vdc" bus="virtio"/>
Aug 17 21:41:08 user nova-compute[72818]:   <serial>78f78863-e13d-4837-bd4d-e57b4d1706f9</serial>
Aug 17 21:41:08 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 21:41:08 user nova-compute[72818]: </disk>
Aug 17 21:41:08 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.network.neutron [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Successfully updated port: bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquired lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.network.neutron [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-026de930-a524-4e91-8ede-78a86917d94c req-e573b727-6004-45c5-85a2-a8c9e1865d10 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Received event network-changed-bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-026de930-a524-4e91-8ede-78a86917d94c req-e573b727-6004-45c5-85a2-a8c9e1865d10 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Refreshing instance network info cache due to event network-changed-bdbc800c-9778-4fed-ba1f-202cf9d03d75. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-026de930-a524-4e91-8ede-78a86917d94c req-e573b727-6004-45c5-85a2-a8c9e1865d10 service nova] Acquiring lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308469.3100815, 44c0f255-d86e-4799-99be-32f00b897a17 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 44c0f255-d86e-4799-99be-32f00b897a17 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:41:09 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully detached device vdc from instance 44c0f255-d86e-4799-99be-32f00b897a17 from the live domain config.
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TnpSyAPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:41:09 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.network.neutron [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a97f25-fa64-4c10-adc7-20af3cf233d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4969a1-4111-47d9-bf35-e04da2669f7f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:09 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:41:09 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:09 user nova-compute[72818]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 (non-flash)
Aug 17 21:41:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:09 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:41:09 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:09 user nova-compute[72818]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 (non-flash)
Aug 17 21:41:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04dfe560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9'): ({'sdf'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Removing single pathed devices sdf {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cf4fba-e3a2-44a4-94b9-e9934c5a0738]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6252b9-79f9-42db-b48c-e1e9aa411e48]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Flushing IO for device /dev/sdf {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2168323-2e06-4660-a230-61527bf91fe6]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d60b58-8240-4883-bf14-967321ea0d98]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] SCSI volumes sdf have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1b5905-d82f-4b17-96a3-1a9f5ef5bd61]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75b23d5-cb2f-4ea8-9103-e4de423e63aa]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9, portal: 172.16.0.220,3260]
Aug 17 21:41:09 user nova-compute[72818]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9, portal: 172.16.0.220,3260] successful.
Aug 17 21:41:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.network.neutron [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updating instance_info_cache with network_info: [{"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f78863-e13d-4837-bd4d-e57b4d1706f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b3bb48-3875-47a9-aca3-0d4c84aedfbc]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] <== disconnect_volume: return (300ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Releasing lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Instance network_info: |[{"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-026de930-a524-4e91-8ede-78a86917d94c req-e573b727-6004-45c5-85a2-a8c9e1865d10 service nova] Acquired lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.network.neutron [req-026de930-a524-4e91-8ede-78a86917d94c req-e573b727-6004-45c5-85a2-a8c9e1865d10 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Refreshing network info cache for port bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Start _get_guest_xml network_info=[{"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:41:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:41:09 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2074664928',display_name='tempest-SnapshotDataIntegrityTests-server-2074664928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2074664928',id=43,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ5rkzJDoxZs+DN6SJ1o7MGb6eJoD4/UvqZZGvk3H2VgAtiZUfJoTV1LdtGmkgaHkO2dwDHzwygEzedXQBXloZCewTW9fpW5A4qtWMqNOVU+5gMDyv8DRwCajB2VAz1cQ==',key_name='tempest-keypair-1967081089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d01ed6842244a2f88a95aa8a29f7eae',ramdisk_id='',reservation_id='r-ois28i0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1922492630',owner_user_name='tempest-SnapshotDataIntegrityTests-1922492630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='214fa313bcc84892928f43a023ab2b1c',uuid=ff7cf0b9-d00e-4595-a279-79d9e7a4801d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Converting VIF {"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:8b:76,bridge_name='br-int',has_traffic_filtering=True,id=bdbc800c-9778-4fed-ba1f-202cf9d03d75,network=Network(83fa75b6-42f0-483f-8a93-5606e6fb6971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc800c-97') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.objects.instance [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'pci_devices' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:41:09 user nova-compute[72818]:   <uuid>ff7cf0b9-d00e-4595-a279-79d9e7a4801d</uuid>
Aug 17 21:41:09 user nova-compute[72818]:   <name>instance-0000002b</name>
Aug 17 21:41:09 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:41:09 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:41:09 user nova-compute[72818]:   <metadata>
Aug 17 21:41:09 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:41:09 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:41:09 user nova-compute[72818]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2074664928</nova:name>
Aug 17 21:41:09 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:41:09</nova:creationTime>
Aug 17 21:41:09 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:41:09 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:41:09 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:41:09 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:41:09 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:41:09 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:41:09 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:41:09 user nova-compute[72818]:       <nova:owner>
Aug 17 21:41:09 user nova-compute[72818]:         <nova:user uuid="214fa313bcc84892928f43a023ab2b1c">tempest-SnapshotDataIntegrityTests-1922492630-project-member</nova:user>
Aug 17 21:41:09 user nova-compute[72818]:         <nova:project uuid="8d01ed6842244a2f88a95aa8a29f7eae">tempest-SnapshotDataIntegrityTests-1922492630</nova:project>
Aug 17 21:41:09 user nova-compute[72818]:       </nova:owner>
Aug 17 21:41:09 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:41:09 user nova-compute[72818]:       <nova:ports>
Aug 17 21:41:09 user nova-compute[72818]:         <nova:port uuid="bdbc800c-9778-4fed-ba1f-202cf9d03d75">
Aug 17 21:41:09 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 21:41:09 user nova-compute[72818]:         </nova:port>
Aug 17 21:41:09 user nova-compute[72818]:       </nova:ports>
Aug 17 21:41:09 user nova-compute[72818]:     </nova:instance>
Aug 17 21:41:09 user nova-compute[72818]:   </metadata>
Aug 17 21:41:09 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:41:09 user nova-compute[72818]:     <system>
Aug 17 21:41:09 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:41:09 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:41:09 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:41:09 user nova-compute[72818]:       <entry name="serial">ff7cf0b9-d00e-4595-a279-79d9e7a4801d</entry>
Aug 17 21:41:09 user nova-compute[72818]:       <entry name="uuid">ff7cf0b9-d00e-4595-a279-79d9e7a4801d</entry>
Aug 17 21:41:09 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:41:09 user nova-compute[72818]:     </system>
Aug 17 21:41:09 user nova-compute[72818]:   </sysinfo>
Aug 17 21:41:09 user nova-compute[72818]:   <os>
Aug 17 21:41:09 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:41:09 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:41:09 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:41:09 user nova-compute[72818]:   </os>
Aug 17 21:41:09 user nova-compute[72818]:   <features>
Aug 17 21:41:09 user nova-compute[72818]:     <acpi/>
Aug 17 21:41:09 user nova-compute[72818]:     <apic/>
Aug 17 21:41:09 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:41:09 user nova-compute[72818]:   </features>
Aug 17 21:41:09 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:41:09 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:41:09 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:41:09 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:41:09 user nova-compute[72818]:   </clock>
Aug 17 21:41:09 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:41:09 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:41:09 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:41:09 user nova-compute[72818]:   </cpu>
Aug 17 21:41:09 user nova-compute[72818]:   <devices>
Aug 17 21:41:09 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:41:09 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:41:09 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk"/>
Aug 17 21:41:09 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:41:09 user nova-compute[72818]:     </disk>
Aug 17 21:41:09 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:41:09 user nova-compute[72818]:       <mac address="fa:16:3e:60:8b:76"/>
Aug 17 21:41:09 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:41:09 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:41:09 user nova-compute[72818]:       <target dev="tapbdbc800c-97"/>
Aug 17 21:41:09 user nova-compute[72818]:     </interface>
Aug 17 21:41:09 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:41:09 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/console.log" append="off"/>
Aug 17 21:41:09 user nova-compute[72818]:     </serial>
Aug 17 21:41:09 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:41:09 user nova-compute[72818]:     <video>
Aug 17 21:41:09 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:41:09 user nova-compute[72818]:     </video>
Aug 17 21:41:09 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:41:09 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:41:09 user nova-compute[72818]:     </rng>
Aug 17 21:41:09 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:41:09 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:41:09 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:41:09 user nova-compute[72818]:     </memballoon>
Aug 17 21:41:09 user nova-compute[72818]:   </devices>
Aug 17 21:41:09 user nova-compute[72818]: </domain>
Aug 17 21:41:09 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2074664928',display_name='tempest-SnapshotDataIntegrityTests-server-2074664928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2074664928',id=43,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ5rkzJDoxZs+DN6SJ1o7MGb6eJoD4/UvqZZGvk3H2VgAtiZUfJoTV1LdtGmkgaHkO2dwDHzwygEzedXQBXloZCewTW9fpW5A4qtWMqNOVU+5gMDyv8DRwCajB2VAz1cQ==',key_name='tempest-keypair-1967081089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d01ed6842244a2f88a95aa8a29f7eae',ramdisk_id='',reservation_id='r-ois28i0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1922492630',owner_user_name='tempest-SnapshotDataIntegrityTests-1922492630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='214fa313bcc84892928f43a023ab2b1c',uuid=ff7cf0b9-d00e-4595-a279-79d9e7a4801d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Converting VIF {"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:8b:76,bridge_name='br-int',has_traffic_filtering=True,id=bdbc800c-9778-4fed-ba1f-202cf9d03d75,network=Network(83fa75b6-42f0-483f-8a93-5606e6fb6971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc800c-97') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG os_vif [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:8b:76,bridge_name='br-int',has_traffic_filtering=True,id=bdbc800c-9778-4fed-ba1f-202cf9d03d75,network=Network(83fa75b6-42f0-483f-8a93-5606e6fb6971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc800c-97') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.network.neutron [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Successfully updated port: b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdbc800c-97, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbdbc800c-97, col_values=(('external_ids', {'iface-id': 'bdbc800c-9778-4fed-ba1f-202cf9d03d75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:8b:76', 'vm-uuid': 'ff7cf0b9-d00e-4595-a279-79d9e7a4801d'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:09 user nova-compute[72818]: INFO os_vif [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:8b:76,bridge_name='br-int',has_traffic_filtering=True,id=bdbc800c-9778-4fed-ba1f-202cf9d03d75,network=Network(83fa75b6-42f0-483f-8a93-5606e6fb6971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc800c-97')
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-49643497-9d1a-4d6e-a68b-d1f93b328620 req-ad685054-0ae4-423a-b4c9-fe30b3acd77c service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-changed-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-49643497-9d1a-4d6e-a68b-d1f93b328620 req-ad685054-0ae4-423a-b4c9-fe30b3acd77c service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Refreshing instance network info cache due to event network-changed-b5ec26be-42c0-4739-9dfd-c65ba939207b. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-49643497-9d1a-4d6e-a68b-d1f93b328620 req-ad685054-0ae4-423a-b4c9-fe30b3acd77c service nova] Acquiring lock "refresh_cache-68b338a7-f643-4635-b2af-d4170504589d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-49643497-9d1a-4d6e-a68b-d1f93b328620 req-ad685054-0ae4-423a-b4c9-fe30b3acd77c service nova] Acquired lock "refresh_cache-68b338a7-f643-4635-b2af-d4170504589d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.network.neutron [req-49643497-9d1a-4d6e-a68b-d1f93b328620 req-ad685054-0ae4-423a-b4c9-fe30b3acd77c service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Refreshing network info cache for port b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "refresh_cache-68b338a7-f643-4635-b2af-d4170504589d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No VIF found with MAC fa:16:3e:60:8b:76, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:41:09 user nova-compute[72818]: DEBUG nova.network.neutron [req-49643497-9d1a-4d6e-a68b-d1f93b328620 req-ad685054-0ae4-423a-b4c9-fe30b3acd77c service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG nova.network.neutron [req-49643497-9d1a-4d6e-a68b-d1f93b328620 req-ad685054-0ae4-423a-b4c9-fe30b3acd77c service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-49643497-9d1a-4d6e-a68b-d1f93b328620 req-ad685054-0ae4-423a-b4c9-fe30b3acd77c service nova] Releasing lock "refresh_cache-68b338a7-f643-4635-b2af-d4170504589d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquired lock "refresh_cache-68b338a7-f643-4635-b2af-d4170504589d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG nova.network.neutron [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG nova.network.neutron [req-026de930-a524-4e91-8ede-78a86917d94c req-e573b727-6004-45c5-85a2-a8c9e1865d10 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updated VIF entry in instance network info cache for port bdbc800c-9778-4fed-ba1f-202cf9d03d75. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG nova.network.neutron [req-026de930-a524-4e91-8ede-78a86917d94c req-e573b727-6004-45c5-85a2-a8c9e1865d10 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updating instance_info_cache with network_info: [{"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-026de930-a524-4e91-8ede-78a86917d94c req-e573b727-6004-45c5-85a2-a8c9e1865d10 service nova] Releasing lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG nova.network.neutron [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG nova.objects.instance [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'flavor' on Instance uuid 44c0f255-d86e-4799-99be-32f00b897a17 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-cc256a04-8fc3-400e-8072-4c749f0e5834 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.683s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG nova.network.neutron [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Updating instance_info_cache with network_info: [{"id": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "address": "fa:16:3e:db:72:3b", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ec26be-42", "ovs_interfaceid": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Releasing lock "refresh_cache-68b338a7-f643-4635-b2af-d4170504589d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Instance network_info: |[{"id": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "address": "fa:16:3e:db:72:3b", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ec26be-42", "ovs_interfaceid": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-44c0f255-d86e-4799-99be-32f00b897a17" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-44c0f255-d86e-4799-99be-32f00b897a17" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:41:10 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Updating instance_info_cache with network_info: [{"id": "a0f3842b-4aa7-4921-abd1-07a633536d86", "address": "fa:16:3e:24:48:82", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f3842b-4a", "ovs_interfaceid": "a0f3842b-4aa7-4921-abd1-07a633536d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-44c0f255-d86e-4799-99be-32f00b897a17" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-649b4ede-1d04-4694-8f14-fb89d051c04b req-2719ae9e-fd59-4156-8bf4-0d43a42a42ca service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Received event network-vif-plugged-bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-649b4ede-1d04-4694-8f14-fb89d051c04b req-2719ae9e-fd59-4156-8bf4-0d43a42a42ca service nova] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-649b4ede-1d04-4694-8f14-fb89d051c04b req-2719ae9e-fd59-4156-8bf4-0d43a42a42ca service nova] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-649b4ede-1d04-4694-8f14-fb89d051c04b req-2719ae9e-fd59-4156-8bf4-0d43a42a42ca service nova] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-649b4ede-1d04-4694-8f14-fb89d051c04b req-2719ae9e-fd59-4156-8bf4-0d43a42a42ca service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] No waiting events found dispatching network-vif-plugged-bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:41:11 user nova-compute[72818]: WARNING nova.compute.manager [req-649b4ede-1d04-4694-8f14-fb89d051c04b req-2719ae9e-fd59-4156-8bf4-0d43a42a42ca service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Received unexpected event network-vif-plugged-bdbc800c-9778-4fed-ba1f-202cf9d03d75 for instance with vm_state building and task_state spawning.
Aug 17 21:41:11 user nova-compute[72818]: INFO nova.compute.manager [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Terminating instance
Aug 17 21:41:11 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-362c87b0-a9ba-4209-9f30-8f6fa155e42b req-9c92cd06-b068-4330-93a0-65a695a50c1b service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Received event network-vif-unplugged-a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-362c87b0-a9ba-4209-9f30-8f6fa155e42b req-9c92cd06-b068-4330-93a0-65a695a50c1b service nova] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-362c87b0-a9ba-4209-9f30-8f6fa155e42b req-9c92cd06-b068-4330-93a0-65a695a50c1b service nova] Lock "44c0f255-d86e-4799-99be-32f00b897a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-362c87b0-a9ba-4209-9f30-8f6fa155e42b req-9c92cd06-b068-4330-93a0-65a695a50c1b service nova] Lock "44c0f255-d86e-4799-99be-32f00b897a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-362c87b0-a9ba-4209-9f30-8f6fa155e42b req-9c92cd06-b068-4330-93a0-65a695a50c1b service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] No waiting events found dispatching network-vif-unplugged-a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-362c87b0-a9ba-4209-9f30-8f6fa155e42b req-9c92cd06-b068-4330-93a0-65a695a50c1b service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Received event network-vif-unplugged-a0f3842b-4aa7-4921-abd1-07a633536d86 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:12 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Instance destroyed successfully.
Aug 17 21:41:12 user nova-compute[72818]: DEBUG nova.objects.instance [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lazy-loading 'resources' on Instance uuid 44c0f255-d86e-4799-99be-32f00b897a17 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1467637435',display_name='tempest-AttachVolumeTestJSON-server-1467637435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1467637435',id=40,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJh1ITYS/Ro8RhbB+rmxuFen572WpqwyPO8gT1+kE8nda8CNyVQMfiu2HHJ6GQ4bxnVu46Q5i/PgZwJhVBf5tYytZJIzcgGv5yQXqevuFynpNdzyvbC+/qPmPOz2qRvIw==',key_name='tempest-keypair-1616055024',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:38:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6482e624bb9417598bb26fa0622641d',ramdisk_id='',reservation_id='r-inpmzaz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1086990444',owner_user_name='tempest-AttachVolumeTestJSON-1086990444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:38:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10aff1c23f1041c485ab50735d2dcc12',uuid=44c0f255-d86e-4799-99be-32f00b897a17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0f3842b-4aa7-4921-abd1-07a633536d86", "address": "fa:16:3e:24:48:82", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f3842b-4a", "ovs_interfaceid": "a0f3842b-4aa7-4921-abd1-07a633536d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converting VIF {"id": "a0f3842b-4aa7-4921-abd1-07a633536d86", "address": "fa:16:3e:24:48:82", "network": {"id": "deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158050258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6482e624bb9417598bb26fa0622641d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f3842b-4a", "ovs_interfaceid": "a0f3842b-4aa7-4921-abd1-07a633536d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:48:82,bridge_name='br-int',has_traffic_filtering=True,id=a0f3842b-4aa7-4921-abd1-07a633536d86,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f3842b-4a') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG os_vif [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:48:82,bridge_name='br-int',has_traffic_filtering=True,id=a0f3842b-4aa7-4921-abd1-07a633536d86,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f3842b-4a') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0f3842b-4a, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:41:12 user nova-compute[72818]: INFO os_vif [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:48:82,bridge_name='br-int',has_traffic_filtering=True,id=a0f3842b-4aa7-4921-abd1-07a633536d86,network=Network(deff2aab-5d4a-47cf-868d-d9e9bbd4e9ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f3842b-4a')
Aug 17 21:41:12 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Deleting instance files /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17_del
Aug 17 21:41:12 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Deletion of /opt/stack/data/nova/instances/44c0f255-d86e-4799-99be-32f00b897a17_del complete
Aug 17 21:41:12 user nova-compute[72818]: INFO nova.compute.manager [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 21:41:12 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "284e9f53-7677-4f21-b998-759f1d151f9d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:12 user nova-compute[72818]: INFO nova.compute.manager [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Detaching volume 3468f71e-713b-4080-8f5a-a048d1f515a7
Aug 17 21:41:12 user nova-compute[72818]: INFO nova.virt.block_device [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Attempting to driver detach volume 3468f71e-713b-4080-8f5a-a048d1f515a7 from mountpoint /dev/vdc
Aug 17 21:41:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Attempting to detach device vdc from instance 284e9f53-7677-4f21-b998-759f1d151f9d from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:41:12 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:41:12 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:41:12 user nova-compute[72818]:   <target dev="vdc" bus="virtio"/>
Aug 17 21:41:12 user nova-compute[72818]:   <serial>3468f71e-713b-4080-8f5a-a048d1f515a7</serial>
Aug 17 21:41:12 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 21:41:12 user nova-compute[72818]: </disk>
Aug 17 21:41:12 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:41:12 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Successfully detached device vdc from instance 284e9f53-7677-4f21-b998-759f1d151f9d from the persistent domain config.
Aug 17 21:41:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 284e9f53-7677-4f21-b998-759f1d151f9d from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:41:12 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:41:12 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:41:12 user nova-compute[72818]:   <target dev="vdc" bus="virtio"/>
Aug 17 21:41:12 user nova-compute[72818]:   <serial>3468f71e-713b-4080-8f5a-a048d1f515a7</serial>
Aug 17 21:41:12 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 21:41:12 user nova-compute[72818]: </disk>
Aug 17 21:41:12 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:12 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308473.068188, 284e9f53-7677-4f21-b998-759f1d151f9d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:41:13 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Successfully detached device vdc from instance 284e9f53-7677-4f21-b998-759f1d151f9d from the live domain config.
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkylWGLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:41:13 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[244d5922-fe33-40c3-8f5d-68995e9353ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea7aa7c-a2bc-443b-a884-00af599d5840]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:13 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:41:13 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:13 user nova-compute[72818]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 (non-flash)
Aug 17 21:41:13 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04d869e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7'): ({'sdc'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Removing single pathed devices sdc {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[679cd2ff-67b4-4824-9676-eacb47550c0b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb42a03-a240-45e3-80d6-2e37180d0fd0]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Flushing IO for device /dev/sdc {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cefe031-bf56-424e-8307-6b9707c187e1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[735f2210-906b-4e31-b50c-09b137a5f9eb]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[834b11ec-c3d8-4a80-94b7-42fbf65063f0]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:41:13 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Took 0.91 seconds to deallocate network for instance.
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4ce53f-1b34-46a4-83fc-5af755a3cf14]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7, portal: 172.16.0.220,3260]
Aug 17 21:41:13 user nova-compute[72818]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7, portal: 172.16.0.220,3260] successful.
Aug 17 21:41:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3468f71e-713b-4080-8f5a-a048d1f515a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe74a16-91eb-4570-b644-f79318f5ec52]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] <== disconnect_volume: return (295ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308473.4594738, ff7cf0b9-d00e-4595-a279-79d9e7a4801d => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:41:13 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] VM Resumed (Lifecycle Event)
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:41:13 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Instance spawned successfully.
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-4d1e72af-8e93-4a90-a50b-36b45a4f732f req-22c85290-ba6d-47bb-a9da-9557f730d830 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Received event network-vif-plugged-bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4d1e72af-8e93-4a90-a50b-36b45a4f732f req-22c85290-ba6d-47bb-a9da-9557f730d830 service nova] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4d1e72af-8e93-4a90-a50b-36b45a4f732f req-22c85290-ba6d-47bb-a9da-9557f730d830 service nova] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4d1e72af-8e93-4a90-a50b-36b45a4f732f req-22c85290-ba6d-47bb-a9da-9557f730d830 service nova] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-4d1e72af-8e93-4a90-a50b-36b45a4f732f req-22c85290-ba6d-47bb-a9da-9557f730d830 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] No waiting events found dispatching network-vif-plugged-bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:41:13 user nova-compute[72818]: WARNING nova.compute.manager [req-4d1e72af-8e93-4a90-a50b-36b45a4f732f req-22c85290-ba6d-47bb-a9da-9557f730d830 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Received unexpected event network-vif-plugged-bdbc800c-9778-4fed-ba1f-202cf9d03d75 for instance with vm_state building and task_state spawning.
Aug 17 21:41:13 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308473.464582, ff7cf0b9-d00e-4595-a279-79d9e7a4801d => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:41:13 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] VM Started (Lifecycle Event)
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Refreshing inventories for resource provider d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Updating ProviderTree inventory for provider d156e3af-684d-47e1-a951-585f9c95fa46 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 21:41:13 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:41:13 user nova-compute[72818]: INFO nova.compute.manager [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Refreshing aggregate associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, aggregates: None {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 21:41:13 user nova-compute[72818]: INFO nova.compute.manager [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Took 6.64 seconds to build instance.
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Refreshing trait associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-91450ad2-e9ce-42ad-9f4d-568f61569251 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.736s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.075s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:41:13 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Deleted allocations for instance 44c0f255-d86e-4799-99be-32f00b897a17
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-08ac1c89-278f-4e20-978a-1f788e615c6c req-160d62a2-8497-4f07-8a33-66638347453b service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Received event network-vif-plugged-a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-08ac1c89-278f-4e20-978a-1f788e615c6c req-160d62a2-8497-4f07-8a33-66638347453b service nova] Acquiring lock "44c0f255-d86e-4799-99be-32f00b897a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-08ac1c89-278f-4e20-978a-1f788e615c6c req-160d62a2-8497-4f07-8a33-66638347453b service nova] Lock "44c0f255-d86e-4799-99be-32f00b897a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-08ac1c89-278f-4e20-978a-1f788e615c6c req-160d62a2-8497-4f07-8a33-66638347453b service nova] Lock "44c0f255-d86e-4799-99be-32f00b897a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-08ac1c89-278f-4e20-978a-1f788e615c6c req-160d62a2-8497-4f07-8a33-66638347453b service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] No waiting events found dispatching network-vif-plugged-a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:41:13 user nova-compute[72818]: WARNING nova.compute.manager [req-08ac1c89-278f-4e20-978a-1f788e615c6c req-160d62a2-8497-4f07-8a33-66638347453b service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Received unexpected event network-vif-plugged-a0f3842b-4aa7-4921-abd1-07a633536d86 for instance with vm_state deleted and task_state None.
Aug 17 21:41:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-08ac1c89-278f-4e20-978a-1f788e615c6c req-160d62a2-8497-4f07-8a33-66638347453b service nova] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Received event network-vif-deleted-a0f3842b-4aa7-4921-abd1-07a633536d86 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-c3de135f-998a-4850-ae26-ba94f6c29d45 tempest-AttachVolumeTestJSON-1086990444 tempest-AttachVolumeTestJSON-1086990444-project-member] Lock "44c0f255-d86e-4799-99be-32f00b897a17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.584s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'flavor' on Instance uuid 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ccde0904-8646-496f-afcc-d5cc77c7be88 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "284e9f53-7677-4f21-b998-759f1d151f9d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.720s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:41:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:16 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:41:16 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8139MB free_disk=25.339557647705078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 01162bf0-7e42-4926-95e3-a286827e16bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 284e9f53-7677-4f21-b998-759f1d151f9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance f1a55f21-4c94-4bcc-be12-5a0d8957fe41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 68b338a7-f643-4635-b2af-d4170504589d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72818) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:41:16 user nova-compute[72818]: INFO nova.compute.claims [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Claim successful on node user
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:41:16 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:41:17 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:41:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG nova.policy [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6934fedf4fb46a4b9e1495aa20a6111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371d253c57734dcfacd1e7e37116258d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:41:17 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Creating image(s)
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "/opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "/opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] There are 0 instances to clean {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.198s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Successfully created port: 8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk 1073741824" returned: 0 in 0.098s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Cannot resize image /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG nova.objects.instance [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lazy-loading 'migration_context' on Instance uuid 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Ensure instance console log exists: /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Successfully updated port: 8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "refresh_cache-1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquired lock "refresh_cache-1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-c81754ce-49c4-4fbd-b569-adcfcf6f6ccb req-088bc5b4-f62f-4b42-a584-50e175f3392d service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Received event network-changed-8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-c81754ce-49c4-4fbd-b569-adcfcf6f6ccb req-088bc5b4-f62f-4b42-a584-50e175f3392d service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Refreshing instance network info cache due to event network-changed-8aa1a575-6e4f-4421-97f3-84373dd2e693. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c81754ce-49c4-4fbd-b569-adcfcf6f6ccb req-088bc5b4-f62f-4b42-a584-50e175f3392d service nova] Acquiring lock "refresh_cache-1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:41:19 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Creating image(s)
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Did not create local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Ensure instance console log exists: /opt/stack/data/nova/instances/68b338a7-f643-4635-b2af-d4170504589d/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Start _get_guest_xml network_info=[{"id": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "address": "fa:16:3e:db:72:3b", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ec26be-42", "ovs_interfaceid": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'd8a27900-0d78-44b9-baec-6552c991433a', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KINOfWGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68b338a7-f643-4635-b2af-d4170504589d', 'attached_at': '', 'detached_at': '', 'volume_id': '0806a3b7-8b6b-4157-827f-7fa2ae255397', 'serial': '0806a3b7-8b6b-4157-827f-7fa2ae255397'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:41:19 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:41:19 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KINOfWGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:41:19 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:41:19 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:41:19 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6f26ab-9ed6-43ee-99c8-8cdcd831b73d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:41:19 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc070d1-5cac-410a-9348-fb664be55703]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397] added
Aug 17 21:41:19 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eff9dc-4a2b-4260-b787-1169a4c5dcf2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[448787ef-4093-4b81-9b81-978791ffbe23]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KINOfWGR {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.network.neutron [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Updating instance_info_cache with network_info: [{"id": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "address": "fa:16:3e:df:41:84", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1a575-6e", "ovs_interfaceid": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KINOfWGR" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e6a246-d4ac-4949-beba-4fd785e60150]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KINOfWGR'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Releasing lock "refresh_cache-1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Instance network_info: |[{"id": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "address": "fa:16:3e:df:41:84", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1a575-6e", "ovs_interfaceid": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c81754ce-49c4-4fbd-b569-adcfcf6f6ccb req-088bc5b4-f62f-4b42-a584-50e175f3392d service nova] Acquired lock "refresh_cache-1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.network.neutron [req-c81754ce-49c4-4fbd-b569-adcfcf6f6ccb req-088bc5b4-f62f-4b42-a584-50e175f3392d service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Refreshing network info cache for port 8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Start _get_guest_xml network_info=[{"id": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "address": "fa:16:3e:df:41:84", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1a575-6e", "ovs_interfaceid": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:41:19 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:41:19 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[757d4cc6-de5b-4267-93c5-f9b79ac7be7b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-710116394',display_name='tempest-VolumesActionsTest-instance-710116394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-710116394',id=45,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='371d253c57734dcfacd1e7e37116258d',ramdisk_id='',reservation_id='r-d4fwaq0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-485654311',owner_user_name='tempest-VolumesActionsTest-485654311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:41:17Z,user_data=None,user_id='c6934fedf4fb46a4b9e1495aa20a6111',uuid=1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "address": "fa:16:3e:df:41:84", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1a575-6e", "ovs_interfaceid": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Converting VIF {"id": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "address": "fa:16:3e:df:41:84", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1a575-6e", "ovs_interfaceid": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:41:84,bridge_name='br-int',has_traffic_filtering=True,id=8aa1a575-6e4f-4421-97f3-84373dd2e693,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1a575-6e') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.objects.instance [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6441c134-0ad3-4067-9607-71b6b202f0e5]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:19 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:19 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:19 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:19 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:41:19 user nova-compute[72818]:   <uuid>1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc</uuid>
Aug 17 21:41:19 user nova-compute[72818]:   <name>instance-0000002d</name>
Aug 17 21:41:19 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:41:19 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:41:19 user nova-compute[72818]:   <metadata>
Aug 17 21:41:19 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:41:19 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:41:19 user nova-compute[72818]:       <nova:name>tempest-VolumesActionsTest-instance-710116394</nova:name>
Aug 17 21:41:19 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:41:19</nova:creationTime>
Aug 17 21:41:19 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:41:19 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:41:19 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:41:19 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:41:19 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:41:19 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:41:19 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:41:19 user nova-compute[72818]:       <nova:owner>
Aug 17 21:41:19 user nova-compute[72818]:         <nova:user uuid="c6934fedf4fb46a4b9e1495aa20a6111">tempest-VolumesActionsTest-485654311-project-member</nova:user>
Aug 17 21:41:19 user nova-compute[72818]:         <nova:project uuid="371d253c57734dcfacd1e7e37116258d">tempest-VolumesActionsTest-485654311</nova:project>
Aug 17 21:41:19 user nova-compute[72818]:       </nova:owner>
Aug 17 21:41:19 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:41:19 user nova-compute[72818]:       <nova:ports>
Aug 17 21:41:19 user nova-compute[72818]:         <nova:port uuid="8aa1a575-6e4f-4421-97f3-84373dd2e693">
Aug 17 21:41:19 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 21:41:19 user nova-compute[72818]:         </nova:port>
Aug 17 21:41:19 user nova-compute[72818]:       </nova:ports>
Aug 17 21:41:19 user nova-compute[72818]:     </nova:instance>
Aug 17 21:41:19 user nova-compute[72818]:   </metadata>
Aug 17 21:41:19 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:41:19 user nova-compute[72818]:     <system>
Aug 17 21:41:19 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:41:19 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:41:19 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:41:19 user nova-compute[72818]:       <entry name="serial">1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc</entry>
Aug 17 21:41:19 user nova-compute[72818]:       <entry name="uuid">1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc</entry>
Aug 17 21:41:19 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:41:19 user nova-compute[72818]:     </system>
Aug 17 21:41:19 user nova-compute[72818]:   </sysinfo>
Aug 17 21:41:19 user nova-compute[72818]:   <os>
Aug 17 21:41:19 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:41:19 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:41:19 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:41:19 user nova-compute[72818]:   </os>
Aug 17 21:41:19 user nova-compute[72818]:   <features>
Aug 17 21:41:19 user nova-compute[72818]:     <acpi/>
Aug 17 21:41:19 user nova-compute[72818]:     <apic/>
Aug 17 21:41:19 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:41:19 user nova-compute[72818]:   </features>
Aug 17 21:41:19 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:41:19 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:41:19 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:41:19 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:41:19 user nova-compute[72818]:   </clock>
Aug 17 21:41:19 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:41:19 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:41:19 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:41:19 user nova-compute[72818]:   </cpu>
Aug 17 21:41:19 user nova-compute[72818]:   <devices>
Aug 17 21:41:19 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:41:19 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:41:19 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk"/>
Aug 17 21:41:19 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:41:19 user nova-compute[72818]:     </disk>
Aug 17 21:41:19 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:41:19 user nova-compute[72818]:       <mac address="fa:16:3e:df:41:84"/>
Aug 17 21:41:19 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:41:19 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:41:19 user nova-compute[72818]:       <target dev="tap8aa1a575-6e"/>
Aug 17 21:41:19 user nova-compute[72818]:     </interface>
Aug 17 21:41:19 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:41:19 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/console.log" append="off"/>
Aug 17 21:41:19 user nova-compute[72818]:     </serial>
Aug 17 21:41:19 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:41:19 user nova-compute[72818]:     <video>
Aug 17 21:41:19 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:41:19 user nova-compute[72818]:     </video>
Aug 17 21:41:19 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:41:19 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:41:19 user nova-compute[72818]:     </rng>
Aug 17 21:41:19 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:41:19 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:41:19 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:41:19 user nova-compute[72818]:     </memballoon>
Aug 17 21:41:19 user nova-compute[72818]:   </devices>
Aug 17 21:41:19 user nova-compute[72818]: </domain>
Aug 17 21:41:19 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-710116394',display_name='tempest-VolumesActionsTest-instance-710116394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-710116394',id=45,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='371d253c57734dcfacd1e7e37116258d',ramdisk_id='',reservation_id='r-d4fwaq0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-485654311',owner_user_name='tempest-VolumesActionsTest-485654311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:41:17Z,user_data=None,user_id='c6934fedf4fb46a4b9e1495aa20a6111',uuid=1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "address": "fa:16:3e:df:41:84", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1a575-6e", "ovs_interfaceid": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Converting VIF {"id": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "address": "fa:16:3e:df:41:84", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1a575-6e", "ovs_interfaceid": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:41:84,bridge_name='br-int',has_traffic_filtering=True,id=8aa1a575-6e4f-4421-97f3-84373dd2e693,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1a575-6e') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_vif [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:41:84,bridge_name='br-int',has_traffic_filtering=True,id=8aa1a575-6e4f-4421-97f3-84373dd2e693,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1a575-6e') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8aa1a575-6e, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8aa1a575-6e, col_values=(('external_ids', {'iface-id': '8aa1a575-6e4f-4421-97f3-84373dd2e693', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:41:84', 'vm-uuid': '1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:19 user nova-compute[72818]: INFO os_vif [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:41:84,bridge_name='br-int',has_traffic_filtering=True,id=8aa1a575-6e4f-4421-97f3-84373dd2e693,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1a575-6e')
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae4a643-dd42-46ff-b489-9381f993e642]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397, portal: 172.16.0.220,3260]
Aug 17 21:41:19 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397, portal: 172.16.0.220,3260] successful.
Aug 17 21:41:19 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[88626548-d636-4aa0-a970-84363f73304e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e610c2-c2db-4a98-a241-47d21f6226f8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:19 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:19 user nova-compute[72818]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 (non-flash)
Aug 17 21:41:19 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:41:19 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:41:19 user nova-compute[72818]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 (non-flash)
Aug 17 21:41:19 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] No VIF found with MAC fa:16:3e:df:41:84, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[00828e58-1760-4d10-be10-bf9c389fddab]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:41:19 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:41:20 user nova-compute[72818]: DEBUG nova.network.neutron [req-c81754ce-49c4-4fbd-b569-adcfcf6f6ccb req-088bc5b4-f62f-4b42-a584-50e175f3392d service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Updated VIF entry in instance network info cache for port 8aa1a575-6e4f-4421-97f3-84373dd2e693. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:41:20 user nova-compute[72818]: DEBUG nova.network.neutron [req-c81754ce-49c4-4fbd-b569-adcfcf6f6ccb req-088bc5b4-f62f-4b42-a584-50e175f3392d service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Updating instance_info_cache with network_info: [{"id": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "address": "fa:16:3e:df:41:84", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1a575-6e", "ovs_interfaceid": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:41:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c81754ce-49c4-4fbd-b569-adcfcf6f6ccb req-088bc5b4-f62f-4b42-a584-50e175f3392d service nova] Releasing lock "refresh_cache-1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:41:20 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:41:20 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KINOfWGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:41:20 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '26636643965306163', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636643965306163', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2065762882',display_name='tempest-TestVolumeBootPattern-server-2065762882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2065762882',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvgvYY4VEzOO1hBWsb20sNrMVs8w/XTYHCJEm0Bvp0JOphCdpXxCT+2Vc1RBvadH4gKZoKMMxsPeL8omuqOhZEcjdNF9Xh2fVwAM7u4vOVW7jR4hyrsil3xbR7zmO8kpg==',key_name='tempest-TestVolumeBootPattern-782174029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-fn52qbgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:41:08Z,user_data=None,user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=68b338a7-f643-4635-b2af-d4170504589d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "address": "fa:16:3e:db:72:3b", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ec26be-42", "ovs_interfaceid": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "address": "fa:16:3e:db:72:3b", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ec26be-42", "ovs_interfaceid": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:72:3b,bridge_name='br-int',has_traffic_filtering=True,id=b5ec26be-42c0-4739-9dfd-c65ba939207b,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ec26be-42') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lazy-loading 'pci_devices' on Instance uuid 68b338a7-f643-4635-b2af-d4170504589d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:41:21 user nova-compute[72818]:   <uuid>68b338a7-f643-4635-b2af-d4170504589d</uuid>
Aug 17 21:41:21 user nova-compute[72818]:   <name>instance-0000002c</name>
Aug 17 21:41:21 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:41:21 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:41:21 user nova-compute[72818]:   <metadata>
Aug 17 21:41:21 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:41:21 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:41:21 user nova-compute[72818]:       <nova:name>tempest-TestVolumeBootPattern-server-2065762882</nova:name>
Aug 17 21:41:21 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:41:19</nova:creationTime>
Aug 17 21:41:21 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:41:21 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:41:21 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:41:21 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:41:21 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:41:21 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:41:21 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:41:21 user nova-compute[72818]:       <nova:owner>
Aug 17 21:41:21 user nova-compute[72818]:         <nova:user uuid="de902559a8794d1a8af9c0efbed4e38a">tempest-TestVolumeBootPattern-973058317-project-member</nova:user>
Aug 17 21:41:21 user nova-compute[72818]:         <nova:project uuid="92abc22a192a44398dffe75ffae6d270">tempest-TestVolumeBootPattern-973058317</nova:project>
Aug 17 21:41:21 user nova-compute[72818]:       </nova:owner>
Aug 17 21:41:21 user nova-compute[72818]:       <nova:ports>
Aug 17 21:41:21 user nova-compute[72818]:         <nova:port uuid="b5ec26be-42c0-4739-9dfd-c65ba939207b">
Aug 17 21:41:21 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 21:41:21 user nova-compute[72818]:         </nova:port>
Aug 17 21:41:21 user nova-compute[72818]:       </nova:ports>
Aug 17 21:41:21 user nova-compute[72818]:     </nova:instance>
Aug 17 21:41:21 user nova-compute[72818]:   </metadata>
Aug 17 21:41:21 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:41:21 user nova-compute[72818]:     <system>
Aug 17 21:41:21 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:41:21 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:41:21 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:41:21 user nova-compute[72818]:       <entry name="serial">68b338a7-f643-4635-b2af-d4170504589d</entry>
Aug 17 21:41:21 user nova-compute[72818]:       <entry name="uuid">68b338a7-f643-4635-b2af-d4170504589d</entry>
Aug 17 21:41:21 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:41:21 user nova-compute[72818]:     </system>
Aug 17 21:41:21 user nova-compute[72818]:   </sysinfo>
Aug 17 21:41:21 user nova-compute[72818]:   <os>
Aug 17 21:41:21 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:41:21 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:41:21 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:41:21 user nova-compute[72818]:   </os>
Aug 17 21:41:21 user nova-compute[72818]:   <features>
Aug 17 21:41:21 user nova-compute[72818]:     <acpi/>
Aug 17 21:41:21 user nova-compute[72818]:     <apic/>
Aug 17 21:41:21 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:41:21 user nova-compute[72818]:   </features>
Aug 17 21:41:21 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:41:21 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:41:21 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:41:21 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:41:21 user nova-compute[72818]:   </clock>
Aug 17 21:41:21 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:41:21 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:41:21 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:41:21 user nova-compute[72818]:   </cpu>
Aug 17 21:41:21 user nova-compute[72818]:   <devices>
Aug 17 21:41:21 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:41:21 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:41:21 user nova-compute[72818]:       <source dev="/dev/sdc"/>
Aug 17 21:41:21 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:41:21 user nova-compute[72818]:       <serial>0806a3b7-8b6b-4157-827f-7fa2ae255397</serial>
Aug 17 21:41:21 user nova-compute[72818]:     </disk>
Aug 17 21:41:21 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:41:21 user nova-compute[72818]:       <mac address="fa:16:3e:db:72:3b"/>
Aug 17 21:41:21 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:41:21 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:41:21 user nova-compute[72818]:       <target dev="tapb5ec26be-42"/>
Aug 17 21:41:21 user nova-compute[72818]:     </interface>
Aug 17 21:41:21 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:41:21 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/68b338a7-f643-4635-b2af-d4170504589d/console.log" append="off"/>
Aug 17 21:41:21 user nova-compute[72818]:     </serial>
Aug 17 21:41:21 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:41:21 user nova-compute[72818]:     <video>
Aug 17 21:41:21 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:41:21 user nova-compute[72818]:     </video>
Aug 17 21:41:21 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:41:21 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:41:21 user nova-compute[72818]:     </rng>
Aug 17 21:41:21 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:41:21 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:41:21 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:41:21 user nova-compute[72818]:     </memballoon>
Aug 17 21:41:21 user nova-compute[72818]:   </devices>
Aug 17 21:41:21 user nova-compute[72818]: </domain>
Aug 17 21:41:21 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2065762882',display_name='tempest-TestVolumeBootPattern-server-2065762882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2065762882',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvgvYY4VEzOO1hBWsb20sNrMVs8w/XTYHCJEm0Bvp0JOphCdpXxCT+2Vc1RBvadH4gKZoKMMxsPeL8omuqOhZEcjdNF9Xh2fVwAM7u4vOVW7jR4hyrsil3xbR7zmO8kpg==',key_name='tempest-TestVolumeBootPattern-782174029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-fn52qbgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:41:08Z,user_data=None,user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=68b338a7-f643-4635-b2af-d4170504589d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "address": "fa:16:3e:db:72:3b", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ec26be-42", "ovs_interfaceid": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "address": "fa:16:3e:db:72:3b", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ec26be-42", "ovs_interfaceid": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:72:3b,bridge_name='br-int',has_traffic_filtering=True,id=b5ec26be-42c0-4739-9dfd-c65ba939207b,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ec26be-42') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG os_vif [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:72:3b,bridge_name='br-int',has_traffic_filtering=True,id=b5ec26be-42c0-4739-9dfd-c65ba939207b,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ec26be-42') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5ec26be-42, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5ec26be-42, col_values=(('external_ids', {'iface-id': 'b5ec26be-42c0-4739-9dfd-c65ba939207b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:72:3b', 'vm-uuid': '68b338a7-f643-4635-b2af-d4170504589d'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:21 user nova-compute[72818]: INFO os_vif [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:72:3b,bridge_name='br-int',has_traffic_filtering=True,id=b5ec26be-42c0-4739-9dfd-c65ba939207b,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ec26be-42')
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] No VIF found with MAC fa:16:3e:db:72:3b, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-19c48941-2e9e-42d1-9376-22926a99d48f req-a1300370-55d8-4872-96eb-eca69bf7dde8 service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Received event network-vif-plugged-8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-19c48941-2e9e-42d1-9376-22926a99d48f req-a1300370-55d8-4872-96eb-eca69bf7dde8 service nova] Acquiring lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-19c48941-2e9e-42d1-9376-22926a99d48f req-a1300370-55d8-4872-96eb-eca69bf7dde8 service nova] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-19c48941-2e9e-42d1-9376-22926a99d48f req-a1300370-55d8-4872-96eb-eca69bf7dde8 service nova] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:21 user nova-compute[72818]: DEBUG nova.compute.manager [req-19c48941-2e9e-42d1-9376-22926a99d48f req-a1300370-55d8-4872-96eb-eca69bf7dde8 service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] No waiting events found dispatching network-vif-plugged-8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:41:21 user nova-compute[72818]: WARNING nova.compute.manager [req-19c48941-2e9e-42d1-9376-22926a99d48f req-a1300370-55d8-4872-96eb-eca69bf7dde8 service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Received unexpected event network-vif-plugged-8aa1a575-6e4f-4421-97f3-84373dd2e693 for instance with vm_state building and task_state spawning.
Aug 17 21:41:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Received event network-vif-plugged-8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] Acquiring lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] No waiting events found dispatching network-vif-plugged-8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:41:23 user nova-compute[72818]: WARNING nova.compute.manager [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Received unexpected event network-vif-plugged-8aa1a575-6e4f-4421-97f3-84373dd2e693 for instance with vm_state building and task_state spawning.
Aug 17 21:41:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] Acquiring lock "68b338a7-f643-4635-b2af-d4170504589d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] No waiting events found dispatching network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:41:23 user nova-compute[72818]: WARNING nova.compute.manager [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received unexpected event network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b for instance with vm_state building and task_state spawning.
Aug 17 21:41:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] Acquiring lock "68b338a7-f643-4635-b2af-d4170504589d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] No waiting events found dispatching network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:41:23 user nova-compute[72818]: WARNING nova.compute.manager [req-5858eab4-7e50-4f14-84b5-a21961dde71b req-5424fefa-fe9d-4d10-bb9a-a1e06058cd92 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received unexpected event network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b for instance with vm_state building and task_state spawning.
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308484.7810597, 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:41:24 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] VM Resumed (Lifecycle Event)
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:41:24 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Instance spawned successfully.
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:24 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308484.7845752, 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:41:24 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] VM Started (Lifecycle Event)
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:41:24 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:41:24 user nova-compute[72818]: INFO nova.compute.manager [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Took 7.38 seconds to spawn the instance on the hypervisor.
Aug 17 21:41:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:41:24 user nova-compute[72818]: INFO nova.compute.manager [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Took 8.33 seconds to build instance.
Aug 17 21:41:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b991742-8246-41f9-baef-75ffb2f0f48f tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.423s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308485.1715834, 68b338a7-f643-4635-b2af-d4170504589d => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:41:25 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 68b338a7-f643-4635-b2af-d4170504589d] VM Resumed (Lifecycle Event)
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:41:25 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Instance spawned successfully.
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:41:25 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 68b338a7-f643-4635-b2af-d4170504589d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308485.1756468, 68b338a7-f643-4635-b2af-d4170504589d => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:41:25 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 68b338a7-f643-4635-b2af-d4170504589d] VM Started (Lifecycle Event)
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:41:25 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 68b338a7-f643-4635-b2af-d4170504589d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:41:25 user nova-compute[72818]: INFO nova.compute.manager [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 17 21:41:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:41:25 user nova-compute[72818]: INFO nova.compute.manager [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Took 18.10 seconds to build instance.
Aug 17 21:41:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8a8a78af-ea45-4347-bc9c-fdda5ca426e8 tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "68b338a7-f643-4635-b2af-d4170504589d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.190s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:25 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:27 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308472.3144052, 44c0f255-d86e-4799-99be-32f00b897a17 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:41:27 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] VM Stopped (Lifecycle Event)
Aug 17 21:41:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-095e6cba-8056-4340-8390-aea18d2e3775 None None] [instance: 44c0f255-d86e-4799-99be-32f00b897a17] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:41:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:37 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:41:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-b05a5fcc-4914-484d-a4c8-9f953cf60ba0 req-c6a24cbd-9d16-46e8-b359-623b1f3e5106 service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Received event network-changed-79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-b05a5fcc-4914-484d-a4c8-9f953cf60ba0 req-c6a24cbd-9d16-46e8-b359-623b1f3e5106 service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Refreshing instance network info cache due to event network-changed-79d3c8d0-5356-4488-af4d-d896cd59ce6d. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:41:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b05a5fcc-4914-484d-a4c8-9f953cf60ba0 req-c6a24cbd-9d16-46e8-b359-623b1f3e5106 service nova] Acquiring lock "refresh_cache-f1a55f21-4c94-4bcc-be12-5a0d8957fe41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:41:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b05a5fcc-4914-484d-a4c8-9f953cf60ba0 req-c6a24cbd-9d16-46e8-b359-623b1f3e5106 service nova] Acquired lock "refresh_cache-f1a55f21-4c94-4bcc-be12-5a0d8957fe41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:41:48 user nova-compute[72818]: DEBUG nova.network.neutron [req-b05a5fcc-4914-484d-a4c8-9f953cf60ba0 req-c6a24cbd-9d16-46e8-b359-623b1f3e5106 service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Refreshing network info cache for port 79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:41:49 user nova-compute[72818]: DEBUG nova.network.neutron [req-b05a5fcc-4914-484d-a4c8-9f953cf60ba0 req-c6a24cbd-9d16-46e8-b359-623b1f3e5106 service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Updated VIF entry in instance network info cache for port 79d3c8d0-5356-4488-af4d-d896cd59ce6d. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:41:49 user nova-compute[72818]: DEBUG nova.network.neutron [req-b05a5fcc-4914-484d-a4c8-9f953cf60ba0 req-c6a24cbd-9d16-46e8-b359-623b1f3e5106 service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Updating instance_info_cache with network_info: [{"id": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "address": "fa:16:3e:0e:a0:d0", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d3c8d0-53", "ovs_interfaceid": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:41:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b05a5fcc-4914-484d-a4c8-9f953cf60ba0 req-c6a24cbd-9d16-46e8-b359-623b1f3e5106 service nova] Releasing lock "refresh_cache-f1a55f21-4c94-4bcc-be12-5a0d8957fe41" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:50 user nova-compute[72818]: INFO nova.compute.manager [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Terminating instance
Aug 17 21:41:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-f5ee9671-37dd-463e-ac53-a9fb1c1ee3d6 req-09c32549-71b0-4b4b-a829-41358383877d service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Received event network-vif-unplugged-79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f5ee9671-37dd-463e-ac53-a9fb1c1ee3d6 req-09c32549-71b0-4b4b-a829-41358383877d service nova] Acquiring lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f5ee9671-37dd-463e-ac53-a9fb1c1ee3d6 req-09c32549-71b0-4b4b-a829-41358383877d service nova] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f5ee9671-37dd-463e-ac53-a9fb1c1ee3d6 req-09c32549-71b0-4b4b-a829-41358383877d service nova] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-f5ee9671-37dd-463e-ac53-a9fb1c1ee3d6 req-09c32549-71b0-4b4b-a829-41358383877d service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] No waiting events found dispatching network-vif-unplugged-79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG nova.compute.manager [req-f5ee9671-37dd-463e-ac53-a9fb1c1ee3d6 req-09c32549-71b0-4b4b-a829-41358383877d service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Received event network-vif-unplugged-79d3c8d0-5356-4488-af4d-d896cd59ce6d for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Instance destroyed successfully.
Aug 17 21:41:50 user nova-compute[72818]: DEBUG nova.objects.instance [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'resources' on Instance uuid f1a55f21-4c94-4bcc-be12-5a0d8957fe41 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1102178916',display_name='tempest-AttachVolumeNegativeTest-server-1102178916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1102178916',id=42,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSPJg58r7t3MIpzSlBte4+fr/fgPHwKjuXssKhldqB4AKuH0OxpIzRxjstXzNPkV+gFfg0hbBDqX+wVEl7SbjsqOpaeKdnQ0ULVzmOs2NEFr4K0J2KdLZg6iKqhmY91Lw==',key_name='tempest-keypair-2118014183',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:40:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ffd845455a84fbf9e1517ffe2af001c',ramdisk_id='',reservation_id='r-icr5r7sx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2048664550',owner_user_name='tempest-AttachVolumeNegativeTest-2048664550-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:40:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d025fb1e3974f5d91a7086343bbe5e1',uuid=f1a55f21-4c94-4bcc-be12-5a0d8957fe41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "address": "fa:16:3e:0e:a0:d0", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d3c8d0-53", "ovs_interfaceid": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converting VIF {"id": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "address": "fa:16:3e:0e:a0:d0", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d3c8d0-53", "ovs_interfaceid": "79d3c8d0-5356-4488-af4d-d896cd59ce6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=79d3c8d0-5356-4488-af4d-d896cd59ce6d,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d3c8d0-53') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG os_vif [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=79d3c8d0-5356-4488-af4d-d896cd59ce6d,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d3c8d0-53') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79d3c8d0-53, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:41:50 user nova-compute[72818]: INFO os_vif [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:a0:d0,bridge_name='br-int',has_traffic_filtering=True,id=79d3c8d0-5356-4488-af4d-d896cd59ce6d,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d3c8d0-53')
Aug 17 21:41:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Deleting instance files /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41_del
Aug 17 21:41:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Deletion of /opt/stack/data/nova/instances/f1a55f21-4c94-4bcc-be12-5a0d8957fe41_del complete
Aug 17 21:41:50 user nova-compute[72818]: INFO nova.compute.manager [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 17 21:41:50 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:41:50 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:41:51 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:41:51 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Took 0.79 seconds to deallocate network for instance.
Aug 17 21:41:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:51 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:41:51 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:41:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:52 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Deleted allocations for instance f1a55f21-4c94-4bcc-be12-5a0d8957fe41
Aug 17 21:41:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-4fe19794-20d2-4adf-bb00-14b06896783e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.944s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:52 user nova-compute[72818]: DEBUG nova.compute.manager [req-9a9f31b4-35d5-47f2-9255-a12be2e9351f req-6beef8d6-341f-427c-824b-07a11548e3ca service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Received event network-vif-plugged-79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9a9f31b4-35d5-47f2-9255-a12be2e9351f req-6beef8d6-341f-427c-824b-07a11548e3ca service nova] Acquiring lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:41:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9a9f31b4-35d5-47f2-9255-a12be2e9351f req-6beef8d6-341f-427c-824b-07a11548e3ca service nova] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:41:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9a9f31b4-35d5-47f2-9255-a12be2e9351f req-6beef8d6-341f-427c-824b-07a11548e3ca service nova] Lock "f1a55f21-4c94-4bcc-be12-5a0d8957fe41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:41:52 user nova-compute[72818]: DEBUG nova.compute.manager [req-9a9f31b4-35d5-47f2-9255-a12be2e9351f req-6beef8d6-341f-427c-824b-07a11548e3ca service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] No waiting events found dispatching network-vif-plugged-79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:41:52 user nova-compute[72818]: WARNING nova.compute.manager [req-9a9f31b4-35d5-47f2-9255-a12be2e9351f req-6beef8d6-341f-427c-824b-07a11548e3ca service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Received unexpected event network-vif-plugged-79d3c8d0-5356-4488-af4d-d896cd59ce6d for instance with vm_state deleted and task_state None.
Aug 17 21:41:52 user nova-compute[72818]: DEBUG nova.compute.manager [req-9a9f31b4-35d5-47f2-9255-a12be2e9351f req-6beef8d6-341f-427c-824b-07a11548e3ca service nova] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Received event network-vif-deleted-79d3c8d0-5356-4488-af4d-d896cd59ce6d {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:41:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:41:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "284e9f53-7677-4f21-b998-759f1d151f9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:02 user nova-compute[72818]: INFO nova.compute.manager [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Terminating instance
Aug 17 21:42:02 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:42:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-c5d43a64-6d23-47ee-866f-3fe6f78cd7ea req-686c7780-19a3-4cc6-a2b9-8398506b342f service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-vif-unplugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c5d43a64-6d23-47ee-866f-3fe6f78cd7ea req-686c7780-19a3-4cc6-a2b9-8398506b342f service nova] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c5d43a64-6d23-47ee-866f-3fe6f78cd7ea req-686c7780-19a3-4cc6-a2b9-8398506b342f service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c5d43a64-6d23-47ee-866f-3fe6f78cd7ea req-686c7780-19a3-4cc6-a2b9-8398506b342f service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-c5d43a64-6d23-47ee-866f-3fe6f78cd7ea req-686c7780-19a3-4cc6-a2b9-8398506b342f service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] No waiting events found dispatching network-vif-unplugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-c5d43a64-6d23-47ee-866f-3fe6f78cd7ea req-686c7780-19a3-4cc6-a2b9-8398506b342f service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-vif-unplugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:42:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Instance destroyed successfully.
Aug 17 21:42:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'resources' on Instance uuid 284e9f53-7677-4f21-b998-759f1d151f9d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1471917594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1471917594',id=35,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHo2Z6RZPRkdg03MXM22dNzinbjZ9356gsX/8BwOTg5F2VFak9gkLfvjkT7eCvd5roCAlsS1utAeXUkNyKMF86k+fZUWgs05GSc3LmYrb+1Yh4jeColgmVjndZWFXEZOg==',key_name='tempest-keypair-8619247',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:39:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a9d9dc56ba84253be502280f64d7b59',ramdisk_id='',reservation_id='r-06vbaj3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-895220279',owner_user_name='tempest-AttachVolumeShelveTestJSON-895220279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcc7e79679c4ebb915828988321acc8',uuid=284e9f53-7677-4f21-b998-759f1d151f9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converting VIF {"id": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "address": "fa:16:3e:71:15:5a", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b51c2ed-5d", "ovs_interfaceid": "5b51c2ed-5dd4-461f-9c75-0ef59e66b00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG os_vif [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b51c2ed-5d, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:42:03 user nova-compute[72818]: INFO os_vif [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=5b51c2ed-5dd4-461f-9c75-0ef59e66b00f,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b51c2ed-5d')
Aug 17 21:42:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Deleting instance files /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d_del
Aug 17 21:42:03 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Deletion of /opt/stack/data/nova/instances/284e9f53-7677-4f21-b998-759f1d151f9d_del complete
Aug 17 21:42:03 user nova-compute[72818]: INFO nova.compute.manager [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 21:42:03 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:42:03 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:42:04 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:42:04 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Took 0.99 seconds to deallocate network for instance.
Aug 17 21:42:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-97ef60f1-2b03-4466-a9bb-8b58838c1852 req-a81c66df-494c-411b-90da-4e7b6efdaba2 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-vif-deleted-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:42:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:04 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:42:04 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:42:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:05 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Deleted allocations for instance 284e9f53-7677-4f21-b998-759f1d151f9d
Aug 17 21:42:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-68db3376-4c2f-4868-8b5a-953a887b5a10 req-63dcff09-2bad-4ebb-b6ab-ee9231751056 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received event network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:42:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-68db3376-4c2f-4868-8b5a-953a887b5a10 req-63dcff09-2bad-4ebb-b6ab-ee9231751056 service nova] Acquiring lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-68db3376-4c2f-4868-8b5a-953a887b5a10 req-63dcff09-2bad-4ebb-b6ab-ee9231751056 service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-68db3376-4c2f-4868-8b5a-953a887b5a10 req-63dcff09-2bad-4ebb-b6ab-ee9231751056 service nova] Lock "284e9f53-7677-4f21-b998-759f1d151f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:05 user nova-compute[72818]: DEBUG nova.compute.manager [req-68db3376-4c2f-4868-8b5a-953a887b5a10 req-63dcff09-2bad-4ebb-b6ab-ee9231751056 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] No waiting events found dispatching network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:42:05 user nova-compute[72818]: WARNING nova.compute.manager [req-68db3376-4c2f-4868-8b5a-953a887b5a10 req-63dcff09-2bad-4ebb-b6ab-ee9231751056 service nova] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Received unexpected event network-vif-plugged-5b51c2ed-5dd4-461f-9c75-0ef59e66b00f for instance with vm_state deleted and task_state None.
Aug 17 21:42:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2beb4830-3763-4a88-99b8-326a467ee2e3 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "284e9f53-7677-4f21-b998-759f1d151f9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.411s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:05 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308510.8125484, f1a55f21-4c94-4bcc-be12-5a0d8957fe41 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:42:05 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] VM Stopped (Lifecycle Event)
Aug 17 21:42:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-65cb20f7-a953-4a96-b4b7-0dc8b3191f8a None None] [instance: f1a55f21-4c94-4bcc-be12-5a0d8957fe41] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:42:05 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:42:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:10 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:42:11 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:42:12 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:42:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:42:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:42:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:42:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:42:12 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:42:12 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid 01162bf0-7e42-4926-95e3-a286827e16bf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:42:13 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Updating instance_info_cache with network_info: [{"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:42:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-01162bf0-7e42-4926-95e3-a286827e16bf" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:42:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:42:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:42:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:42:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:42:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:42:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:42:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:42:14 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:42:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:14 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:42:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:42:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:42:16 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:42:16 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:42:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=7938MB free_disk=25.32091522216797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 01162bf0-7e42-4926-95e3-a286827e16bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 68b338a7-f643-4635-b2af-d4170504589d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:42:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:42:17 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:42:17 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:42:17 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:42:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:18 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308523.5810926, 284e9f53-7677-4f21-b998-759f1d151f9d => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:42:18 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] VM Stopped (Lifecycle Event)
Aug 17 21:42:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-57e7b858-7c1e-4f5b-bc9c-5a2757ffbb3c None None] [instance: 284e9f53-7677-4f21-b998-759f1d151f9d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:42:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 01162bf0-7e42-4926-95e3-a286827e16bf {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 68b338a7-f643-4635-b2af-d4170504589d {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "01162bf0-7e42-4926-95e3-a286827e16bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "01162bf0-7e42-4926-95e3-a286827e16bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "68b338a7-f643-4635-b2af-d4170504589d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "68b338a7-f643-4635-b2af-d4170504589d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "01162bf0-7e42-4926-95e3-a286827e16bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "68b338a7-f643-4635-b2af-d4170504589d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:42:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:42:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "01162bf0-7e42-4926-95e3-a286827e16bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "01162bf0-7e42-4926-95e3-a286827e16bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:41 user nova-compute[72818]: INFO nova.compute.manager [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Detaching volume 0c206b38-2e71-4181-9d7d-a8582c3ae81a
Aug 17 21:42:41 user nova-compute[72818]: INFO nova.virt.block_device [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Attempting to driver detach volume 0c206b38-2e71-4181-9d7d-a8582c3ae81a from mountpoint /dev/vdb
Aug 17 21:42:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Attempting to detach device vdb from instance 01162bf0-7e42-4926-95e3-a286827e16bf from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:42:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:42:41 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:42:41 user nova-compute[72818]:   <source dev="/dev/sdd"/>
Aug 17 21:42:41 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:42:41 user nova-compute[72818]:   <serial>0c206b38-2e71-4181-9d7d-a8582c3ae81a</serial>
Aug 17 21:42:41 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:42:41 user nova-compute[72818]: </disk>
Aug 17 21:42:41 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:42:41 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully detached device vdb from instance 01162bf0-7e42-4926-95e3-a286827e16bf from the persistent domain config.
Aug 17 21:42:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01162bf0-7e42-4926-95e3-a286827e16bf from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:42:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:42:41 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:42:41 user nova-compute[72818]:   <source dev="/dev/sdd"/>
Aug 17 21:42:41 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:42:41 user nova-compute[72818]:   <serial>0c206b38-2e71-4181-9d7d-a8582c3ae81a</serial>
Aug 17 21:42:41 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:42:41 user nova-compute[72818]: </disk>
Aug 17 21:42:41 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308562.355509, 01162bf0-7e42-4926-95e3-a286827e16bf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01162bf0-7e42-4926-95e3-a286827e16bf {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:42:42 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully detached device vdb from instance 01162bf0-7e42-4926-95e3-a286827e16bf from the live domain config.
Aug 17 21:42:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujDWQLUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:42:42 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef4228b-1562-4149-b90f-d23eb3e7c5e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca42d66-3af2-43d0-b0dd-cde00a4f6fc4]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:42:42 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:42:42 user nova-compute[72818]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 (non-flash)
Aug 17 21:42:42 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:42:42 user nova-compute[72818]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a (non-flash)
Aug 17 21:42:42 user nova-compute[72818]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 (non-flash)
Aug 17 21:42:42 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f48108f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a'): ({'sdd'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Removing single pathed devices sdd {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c472a-3c01-47c5-84bd-17f189873a44]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eb7206-f039-444a-bde8-ed933dd58487]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Flushing IO for device /dev/sdd {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[219121e8-60b5-4f6e-bf4e-5ced39710def]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[745e8278-dc43-4a5e-b567-0f0711ded9c9]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] SCSI volumes sdd have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec2a399-ba48-4ff0-a3fc-32f21138a185]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3585493-892e-476e-9cc4-5b678c34a447]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a, portal: 172.16.0.220,3260]
Aug 17 21:42:42 user nova-compute[72818]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a, portal: 172.16.0.220,3260] successful.
Aug 17 21:42:42 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c206b38-2e71-4181-9d7d-a8582c3ae81a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[891fbd49-f8f2-41d8-b2f3-080d53df3f5a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] <== disconnect_volume: return (285ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:42:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:42:43 user nova-compute[72818]: DEBUG nova.objects.instance [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'flavor' on Instance uuid 01162bf0-7e42-4926-95e3-a286827e16bf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:42:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-0fc17268-dcae-4f85-bca4-10b427c07ae5 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "01162bf0-7e42-4926-95e3-a286827e16bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.652s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "2551d322-916b-4b81-9e50-7c174108b741" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:42:57 user nova-compute[72818]: INFO nova.compute.claims [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Claim successful on node user
Aug 17 21:42:57 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG nova.network.neutron [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:42:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:42:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG nova.policy [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbcc7e79679c4ebb915828988321acc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9d9dc56ba84253be502280f64d7b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:42:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Creating image(s)
Aug 17 21:42:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "/opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "/opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "/opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:57 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk 1073741824" returned: 0 in 0.060s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-90ce7e02-3b5c-4f74-ba88-46a17f17fe93 req-b46db4f7-038b-489e-b59a-a672d1f01275 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Received event network-changed-bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-90ce7e02-3b5c-4f74-ba88-46a17f17fe93 req-b46db4f7-038b-489e-b59a-a672d1f01275 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Refreshing instance network info cache due to event network-changed-bdbc800c-9778-4fed-ba1f-202cf9d03d75. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-90ce7e02-3b5c-4f74-ba88-46a17f17fe93 req-b46db4f7-038b-489e-b59a-a672d1f01275 service nova] Acquiring lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-90ce7e02-3b5c-4f74-ba88-46a17f17fe93 req-b46db4f7-038b-489e-b59a-a672d1f01275 service nova] Acquired lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG nova.network.neutron [req-90ce7e02-3b5c-4f74-ba88-46a17f17fe93 req-b46db4f7-038b-489e-b59a-a672d1f01275 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Refreshing network info cache for port bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.191s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Cannot resize image /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG nova.objects.instance [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'migration_context' on Instance uuid 2551d322-916b-4b81-9e50-7c174108b741 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Ensure instance console log exists: /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG nova.network.neutron [req-90ce7e02-3b5c-4f74-ba88-46a17f17fe93 req-b46db4f7-038b-489e-b59a-a672d1f01275 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updated VIF entry in instance network info cache for port bdbc800c-9778-4fed-ba1f-202cf9d03d75. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG nova.network.neutron [req-90ce7e02-3b5c-4f74-ba88-46a17f17fe93 req-b46db4f7-038b-489e-b59a-a672d1f01275 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updating instance_info_cache with network_info: [{"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:42:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-90ce7e02-3b5c-4f74-ba88-46a17f17fe93 req-b46db4f7-038b-489e-b59a-a672d1f01275 service nova] Releasing lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:42:59 user nova-compute[72818]: DEBUG nova.network.neutron [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Successfully created port: b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:42:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-30e945a3-0c6b-4b52-a0ba-293efd936edd req-1336a02a-afc0-46a7-bbab-1eefd1781b85 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-changed-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:42:59 user nova-compute[72818]: DEBUG nova.compute.manager [req-30e945a3-0c6b-4b52-a0ba-293efd936edd req-1336a02a-afc0-46a7-bbab-1eefd1781b85 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Refreshing instance network info cache due to event network-changed-b5ec26be-42c0-4739-9dfd-c65ba939207b. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:42:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-30e945a3-0c6b-4b52-a0ba-293efd936edd req-1336a02a-afc0-46a7-bbab-1eefd1781b85 service nova] Acquiring lock "refresh_cache-68b338a7-f643-4635-b2af-d4170504589d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:42:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-30e945a3-0c6b-4b52-a0ba-293efd936edd req-1336a02a-afc0-46a7-bbab-1eefd1781b85 service nova] Acquired lock "refresh_cache-68b338a7-f643-4635-b2af-d4170504589d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:42:59 user nova-compute[72818]: DEBUG nova.network.neutron [req-30e945a3-0c6b-4b52-a0ba-293efd936edd req-1336a02a-afc0-46a7-bbab-1eefd1781b85 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Refreshing network info cache for port b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.network.neutron [req-30e945a3-0c6b-4b52-a0ba-293efd936edd req-1336a02a-afc0-46a7-bbab-1eefd1781b85 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Updated VIF entry in instance network info cache for port b5ec26be-42c0-4739-9dfd-c65ba939207b. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.network.neutron [req-30e945a3-0c6b-4b52-a0ba-293efd936edd req-1336a02a-afc0-46a7-bbab-1eefd1781b85 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Updating instance_info_cache with network_info: [{"id": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "address": "fa:16:3e:db:72:3b", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ec26be-42", "ovs_interfaceid": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-30e945a3-0c6b-4b52-a0ba-293efd936edd req-1336a02a-afc0-46a7-bbab-1eefd1781b85 service nova] Releasing lock "refresh_cache-68b338a7-f643-4635-b2af-d4170504589d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Successfully updated port: b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquired lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.compute.manager [req-cdde8561-cfd2-46c8-9516-47ebd76dada5 req-27d7cfad-982e-468a-ba29-0f0b7e2cd536 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-changed-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.compute.manager [req-cdde8561-cfd2-46c8-9516-47ebd76dada5 req-27d7cfad-982e-468a-ba29-0f0b7e2cd536 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Refreshing instance network info cache due to event network-changed-b9826839-7693-451b-9051-a4a87db6e9ac. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cdde8561-cfd2-46c8-9516-47ebd76dada5 req-27d7cfad-982e-468a-ba29-0f0b7e2cd536 service nova] Acquiring lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.network.neutron [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updating instance_info_cache with network_info: [{"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Releasing lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.compute.manager [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Instance network_info: |[{"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cdde8561-cfd2-46c8-9516-47ebd76dada5 req-27d7cfad-982e-468a-ba29-0f0b7e2cd536 service nova] Acquired lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.network.neutron [req-cdde8561-cfd2-46c8-9516-47ebd76dada5 req-27d7cfad-982e-468a-ba29-0f0b7e2cd536 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Refreshing network info cache for port b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Start _get_guest_xml network_info=[{"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:43:00 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:43:00 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1377529842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1377529842',id=46,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDspgLsuK0Yrn4L/u+cPnmrsz3U7bF8hKZw6mIacC7jBzHbCCKbAxi+HKKhjJ0ZuHJrpFY126zMOVHFgOlvJzoSDf2KbmNaV3WHtsZGkeYThqwZyi0L+H4cNNMIKBxAHw==',key_name='tempest-keypair-581168616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a9d9dc56ba84253be502280f64d7b59',ramdisk_id='',reservation_id='r-grwff5oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-895220279',owner_user_name='tempest-AttachVolumeShelveTestJSON-895220279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:42:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcc7e79679c4ebb915828988321acc8',uuid=2551d322-916b-4b81-9e50-7c174108b741,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converting VIF {"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.objects.instance [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'pci_devices' on Instance uuid 2551d322-916b-4b81-9e50-7c174108b741 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:43:00 user nova-compute[72818]:   <uuid>2551d322-916b-4b81-9e50-7c174108b741</uuid>
Aug 17 21:43:00 user nova-compute[72818]:   <name>instance-0000002e</name>
Aug 17 21:43:00 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:43:00 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:43:00 user nova-compute[72818]:   <metadata>
Aug 17 21:43:00 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:43:00 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:43:00 user nova-compute[72818]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1377529842</nova:name>
Aug 17 21:43:00 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:43:00</nova:creationTime>
Aug 17 21:43:00 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:43:00 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:43:00 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:43:00 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:43:00 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:43:00 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:43:00 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:43:00 user nova-compute[72818]:       <nova:owner>
Aug 17 21:43:00 user nova-compute[72818]:         <nova:user uuid="fbcc7e79679c4ebb915828988321acc8">tempest-AttachVolumeShelveTestJSON-895220279-project-member</nova:user>
Aug 17 21:43:00 user nova-compute[72818]:         <nova:project uuid="4a9d9dc56ba84253be502280f64d7b59">tempest-AttachVolumeShelveTestJSON-895220279</nova:project>
Aug 17 21:43:00 user nova-compute[72818]:       </nova:owner>
Aug 17 21:43:00 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:43:00 user nova-compute[72818]:       <nova:ports>
Aug 17 21:43:00 user nova-compute[72818]:         <nova:port uuid="b9826839-7693-451b-9051-a4a87db6e9ac">
Aug 17 21:43:00 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 21:43:00 user nova-compute[72818]:         </nova:port>
Aug 17 21:43:00 user nova-compute[72818]:       </nova:ports>
Aug 17 21:43:00 user nova-compute[72818]:     </nova:instance>
Aug 17 21:43:00 user nova-compute[72818]:   </metadata>
Aug 17 21:43:00 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:43:00 user nova-compute[72818]:     <system>
Aug 17 21:43:00 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:43:00 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:43:00 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:43:00 user nova-compute[72818]:       <entry name="serial">2551d322-916b-4b81-9e50-7c174108b741</entry>
Aug 17 21:43:00 user nova-compute[72818]:       <entry name="uuid">2551d322-916b-4b81-9e50-7c174108b741</entry>
Aug 17 21:43:00 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:43:00 user nova-compute[72818]:     </system>
Aug 17 21:43:00 user nova-compute[72818]:   </sysinfo>
Aug 17 21:43:00 user nova-compute[72818]:   <os>
Aug 17 21:43:00 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:43:00 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:43:00 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:43:00 user nova-compute[72818]:   </os>
Aug 17 21:43:00 user nova-compute[72818]:   <features>
Aug 17 21:43:00 user nova-compute[72818]:     <acpi/>
Aug 17 21:43:00 user nova-compute[72818]:     <apic/>
Aug 17 21:43:00 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:43:00 user nova-compute[72818]:   </features>
Aug 17 21:43:00 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:43:00 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:43:00 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:43:00 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:43:00 user nova-compute[72818]:   </clock>
Aug 17 21:43:00 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:43:00 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:43:00 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:43:00 user nova-compute[72818]:   </cpu>
Aug 17 21:43:00 user nova-compute[72818]:   <devices>
Aug 17 21:43:00 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:43:00 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:43:00 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk"/>
Aug 17 21:43:00 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:43:00 user nova-compute[72818]:     </disk>
Aug 17 21:43:00 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:43:00 user nova-compute[72818]:       <mac address="fa:16:3e:4c:85:23"/>
Aug 17 21:43:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:43:00 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:43:00 user nova-compute[72818]:       <target dev="tapb9826839-76"/>
Aug 17 21:43:00 user nova-compute[72818]:     </interface>
Aug 17 21:43:00 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:43:00 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/console.log" append="off"/>
Aug 17 21:43:00 user nova-compute[72818]:     </serial>
Aug 17 21:43:00 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:43:00 user nova-compute[72818]:     <video>
Aug 17 21:43:00 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:43:00 user nova-compute[72818]:     </video>
Aug 17 21:43:00 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:43:00 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:43:00 user nova-compute[72818]:     </rng>
Aug 17 21:43:00 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:43:00 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:43:00 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:43:00 user nova-compute[72818]:     </memballoon>
Aug 17 21:43:00 user nova-compute[72818]:   </devices>
Aug 17 21:43:00 user nova-compute[72818]: </domain>
Aug 17 21:43:00 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1377529842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1377529842',id=46,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDspgLsuK0Yrn4L/u+cPnmrsz3U7bF8hKZw6mIacC7jBzHbCCKbAxi+HKKhjJ0ZuHJrpFY126zMOVHFgOlvJzoSDf2KbmNaV3WHtsZGkeYThqwZyi0L+H4cNNMIKBxAHw==',key_name='tempest-keypair-581168616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a9d9dc56ba84253be502280f64d7b59',ramdisk_id='',reservation_id='r-grwff5oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-895220279',owner_user_name='tempest-AttachVolumeShelveTestJSON-895220279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:42:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcc7e79679c4ebb915828988321acc8',uuid=2551d322-916b-4b81-9e50-7c174108b741,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converting VIF {"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG os_vif [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9826839-76, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9826839-76, col_values=(('external_ids', {'iface-id': 'b9826839-7693-451b-9051-a4a87db6e9ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:85:23', 'vm-uuid': '2551d322-916b-4b81-9e50-7c174108b741'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:00 user nova-compute[72818]: INFO os_vif [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76')
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] No VIF found with MAC fa:16:3e:4c:85:23, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "68b338a7-f643-4635-b2af-d4170504589d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "68b338a7-f643-4635-b2af-d4170504589d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "68b338a7-f643-4635-b2af-d4170504589d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:00 user nova-compute[72818]: INFO nova.compute.manager [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Terminating instance
Aug 17 21:43:01 user nova-compute[72818]: DEBUG nova.compute.manager [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG nova.network.neutron [req-cdde8561-cfd2-46c8-9516-47ebd76dada5 req-27d7cfad-982e-468a-ba29-0f0b7e2cd536 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updated VIF entry in instance network info cache for port b9826839-7693-451b-9051-a4a87db6e9ac. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG nova.network.neutron [req-cdde8561-cfd2-46c8-9516-47ebd76dada5 req-27d7cfad-982e-468a-ba29-0f0b7e2cd536 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updating instance_info_cache with network_info: [{"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cdde8561-cfd2-46c8-9516-47ebd76dada5 req-27d7cfad-982e-468a-ba29-0f0b7e2cd536 service nova] Releasing lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-changed-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG nova.compute.manager [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Refreshing instance network info cache due to event network-changed-b5ec26be-42c0-4739-9dfd-c65ba939207b. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] Acquiring lock "refresh_cache-68b338a7-f643-4635-b2af-d4170504589d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] Acquired lock "refresh_cache-68b338a7-f643-4635-b2af-d4170504589d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG nova.network.neutron [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Refreshing network info cache for port b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.network.neutron [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Updated VIF entry in instance network info cache for port b5ec26be-42c0-4739-9dfd-c65ba939207b. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.network.neutron [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Updating instance_info_cache with network_info: [{"id": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "address": "fa:16:3e:db:72:3b", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ec26be-42", "ovs_interfaceid": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] Releasing lock "refresh_cache-68b338a7-f643-4635-b2af-d4170504589d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-vif-unplugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] Acquiring lock "68b338a7-f643-4635-b2af-d4170504589d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] No waiting events found dispatching network-vif-unplugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-vif-unplugged-b5ec26be-42c0-4739-9dfd-c65ba939207b for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] Acquiring lock "68b338a7-f643-4635-b2af-d4170504589d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] No waiting events found dispatching network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:02 user nova-compute[72818]: WARNING nova.compute.manager [req-f582a95b-196f-47d8-a214-adc21fb58ab4 req-937c0d06-dc49-412a-bca9-3d410e7ee8a2 service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received unexpected event network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b for instance with vm_state active and task_state deleting.
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Instance destroyed successfully.
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.objects.instance [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lazy-loading 'resources' on Instance uuid 68b338a7-f643-4635-b2af-d4170504589d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2065762882',display_name='tempest-TestVolumeBootPattern-server-2065762882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2065762882',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvgvYY4VEzOO1hBWsb20sNrMVs8w/XTYHCJEm0Bvp0JOphCdpXxCT+2Vc1RBvadH4gKZoKMMxsPeL8omuqOhZEcjdNF9Xh2fVwAM7u4vOVW7jR4hyrsil3xbR7zmO8kpg==',key_name='tempest-TestVolumeBootPattern-782174029',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-fn52qbgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:41:25Z,user_data=None,user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=68b338a7-f643-4635-b2af-d4170504589d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "address": "fa:16:3e:db:72:3b", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ec26be-42", "ovs_interfaceid": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "address": "fa:16:3e:db:72:3b", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ec26be-42", "ovs_interfaceid": "b5ec26be-42c0-4739-9dfd-c65ba939207b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:72:3b,bridge_name='br-int',has_traffic_filtering=True,id=b5ec26be-42c0-4739-9dfd-c65ba939207b,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ec26be-42') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_vif [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:72:3b,bridge_name='br-int',has_traffic_filtering=True,id=b5ec26be-42c0-4739-9dfd-c65ba939207b,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ec26be-42') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5ec26be-42, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: INFO os_vif [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:72:3b,bridge_name='br-int',has_traffic_filtering=True,id=b5ec26be-42c0-4739-9dfd-c65ba939207b,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ec26be-42')
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KINOfWGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:43:02 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1991b7c1-e410-4dc4-85d5-753c2826a423]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37a7485-a20e-43c3-95c8-ba6df20b801c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:43:02 user nova-compute[72818]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 (non-flash)
Aug 17 21:43:02 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:43:02 user nova-compute[72818]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 (non-flash)
Aug 17 21:43:02 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f2860ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397'): ({'sdc'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Removing single pathed devices sdc {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab090b76-3776-44d0-8fcb-b3dcfc925d43]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade3eee1-2da7-4ea0-955e-70b855913f67]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flushing IO for device /dev/sdc {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7ded3c-cab7-4786-bf71-d9da884cc989]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb0be5e-f4e2-43e9-b50b-6980ce69360b]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[942ad8e3-a30d-44e1-93f3-3cde61dcc4f5]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf263e42-2d54-4b63-90d7-a2ce1e4f2887]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397, portal: 172.16.0.220,3260]
Aug 17 21:43:02 user nova-compute[72818]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397, portal: 172.16.0.220,3260] successful.
Aug 17 21:43:02 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0806a3b7-8b6b-4157-827f-7fa2ae255397 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2fcc63-5d73-4943-a1bb-ede9b52c5643]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== disconnect_volume: return (342ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:43:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Deleting instance files /opt/stack/data/nova/instances/68b338a7-f643-4635-b2af-d4170504589d_del
Aug 17 21:43:02 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Deletion of /opt/stack/data/nova/instances/68b338a7-f643-4635-b2af-d4170504589d_del complete
Aug 17 21:43:02 user nova-compute[72818]: INFO nova.compute.manager [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Took 1.70 seconds to destroy the instance on the hypervisor.
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 68b338a7-f643-4635-b2af-d4170504589d] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-9fbdce62-b556-479f-918a-1cad5742d070 req-6cb73278-8478-4a1c-8e33-d33dde1bc2cf service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9fbdce62-b556-479f-918a-1cad5742d070 req-6cb73278-8478-4a1c-8e33-d33dde1bc2cf service nova] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9fbdce62-b556-479f-918a-1cad5742d070 req-6cb73278-8478-4a1c-8e33-d33dde1bc2cf service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9fbdce62-b556-479f-918a-1cad5742d070 req-6cb73278-8478-4a1c-8e33-d33dde1bc2cf service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:02 user nova-compute[72818]: DEBUG nova.compute.manager [req-9fbdce62-b556-479f-918a-1cad5742d070 req-6cb73278-8478-4a1c-8e33-d33dde1bc2cf service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] No waiting events found dispatching network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:02 user nova-compute[72818]: WARNING nova.compute.manager [req-9fbdce62-b556-479f-918a-1cad5742d070 req-6cb73278-8478-4a1c-8e33-d33dde1bc2cf service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received unexpected event network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac for instance with vm_state building and task_state spawning.
Aug 17 21:43:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:43:03 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Took 0.66 seconds to deallocate network for instance.
Aug 17 21:43:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-577eab25-ff7e-4905-8678-565855ebabfc req-dc748575-30be-4f84-9e54-6884fb414c8e service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-vif-deleted-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] Acquiring lock "68b338a7-f643-4635-b2af-d4170504589d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] No waiting events found dispatching network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:03 user nova-compute[72818]: WARNING nova.compute.manager [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received unexpected event network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b for instance with vm_state active and task_state deleting.
Aug 17 21:43:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] Acquiring lock "68b338a7-f643-4635-b2af-d4170504589d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] No waiting events found dispatching network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:03 user nova-compute[72818]: WARNING nova.compute.manager [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received unexpected event network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b for instance with vm_state active and task_state deleting.
Aug 17 21:43:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-vif-unplugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] Acquiring lock "68b338a7-f643-4635-b2af-d4170504589d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] No waiting events found dispatching network-vif-unplugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-vif-unplugged-b5ec26be-42c0-4739-9dfd-c65ba939207b for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received event network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] Acquiring lock "68b338a7-f643-4635-b2af-d4170504589d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] Lock "68b338a7-f643-4635-b2af-d4170504589d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG nova.compute.manager [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] No waiting events found dispatching network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:03 user nova-compute[72818]: WARNING nova.compute.manager [req-15a3d6fb-6a41-4992-8dec-ce585bd1faa3 req-3ffc8bb2-3d65-41b3-a8f0-38928b0c34ad service nova] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Received unexpected event network-vif-plugged-b5ec26be-42c0-4739-9dfd-c65ba939207b for instance with vm_state active and task_state deleting.
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'flavor' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:04 user nova-compute[72818]: INFO nova.compute.manager [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Took 0.78 seconds to detach 1 volumes for instance.
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:04 user nova-compute[72818]: INFO nova.compute.manager [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attaching volume 20e5a393-0674-49a6-86fe-bd914cb8d038 to /dev/vdb
Aug 17 21:43:04 user nova-compute[72818]: DEBUG os_brick.utils [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5752d4-4d84-4048-bcc4-857103c37e98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefd4588-b0ba-4fcf-8e3f-c338ffc414e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df0f221-ed28-488b-948d-39ba0bc0d264]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a735fa2-cf2b-4d5c-a923-3a52b1b97aa3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:43:04 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d68776-adb9-4941-a50d-61dca7fb69f7]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG os_brick.utils [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updating existing volume attachment record: 28262ca1-e19d-43d9-a8a1-34b83b7b9046 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:04 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Deleted allocations for instance 68b338a7-f643-4635-b2af-d4170504589d
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-dc548a9e-2203-4dfc-ac87-97b47105f0fe tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "68b338a7-f643-4635-b2af-d4170504589d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.603s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308584.806242, 2551d322-916b-4b81-9e50-7c174108b741 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:43:04 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] VM Resumed (Lifecycle Event)
Aug 17 21:43:04 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Instance spawned successfully.
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:43:04 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308584.8081257, 2551d322-916b-4b81-9e50-7c174108b741 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:43:04 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] VM Started (Lifecycle Event)
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-f5f7efb1-9071-4c8d-aa2c-7cfba477a408 req-c24022d8-57b3-4a73-b662-dc45927a9f04 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f5f7efb1-9071-4c8d-aa2c-7cfba477a408 req-c24022d8-57b3-4a73-b662-dc45927a9f04 service nova] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f5f7efb1-9071-4c8d-aa2c-7cfba477a408 req-c24022d8-57b3-4a73-b662-dc45927a9f04 service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f5f7efb1-9071-4c8d-aa2c-7cfba477a408 req-c24022d8-57b3-4a73-b662-dc45927a9f04 service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-f5f7efb1-9071-4c8d-aa2c-7cfba477a408 req-c24022d8-57b3-4a73-b662-dc45927a9f04 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] No waiting events found dispatching network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:04 user nova-compute[72818]: WARNING nova.compute.manager [req-f5f7efb1-9071-4c8d-aa2c-7cfba477a408 req-c24022d8-57b3-4a73-b662-dc45927a9f04 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received unexpected event network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac for instance with vm_state building and task_state spawning.
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:43:04 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:43:04 user nova-compute[72818]: INFO nova.compute.manager [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Took 7.10 seconds to spawn the instance on the hypervisor.
Aug 17 21:43:04 user nova-compute[72818]: DEBUG nova.compute.manager [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:43:05 user nova-compute[72818]: INFO nova.compute.manager [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Took 7.75 seconds to build instance.
Aug 17 21:43:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-85c0d84e-5ae6-4166-881e-6c6419540f6f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "2551d322-916b-4b81-9e50-7c174108b741" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.858s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:05 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:07 user nova-compute[72818]: INFO nova.compute.manager [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Terminating instance
Aug 17 21:43:07 user nova-compute[72818]: DEBUG nova.compute.manager [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-5256b88a-64f4-4646-9f7d-84c39c0530c7 req-1c743597-2f48-4ca5-9ee3-8326f68a7291 service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Received event network-vif-unplugged-8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5256b88a-64f4-4646-9f7d-84c39c0530c7 req-1c743597-2f48-4ca5-9ee3-8326f68a7291 service nova] Acquiring lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5256b88a-64f4-4646-9f7d-84c39c0530c7 req-1c743597-2f48-4ca5-9ee3-8326f68a7291 service nova] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5256b88a-64f4-4646-9f7d-84c39c0530c7 req-1c743597-2f48-4ca5-9ee3-8326f68a7291 service nova] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-5256b88a-64f4-4646-9f7d-84c39c0530c7 req-1c743597-2f48-4ca5-9ee3-8326f68a7291 service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] No waiting events found dispatching network-vif-unplugged-8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:07 user nova-compute[72818]: DEBUG nova.compute.manager [req-5256b88a-64f4-4646-9f7d-84c39c0530c7 req-1c743597-2f48-4ca5-9ee3-8326f68a7291 service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Received event network-vif-unplugged-8aa1a575-6e4f-4421-97f3-84373dd2e693 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:43:08 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Instance destroyed successfully.
Aug 17 21:43:08 user nova-compute[72818]: DEBUG nova.objects.instance [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lazy-loading 'resources' on Instance uuid 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-710116394',display_name='tempest-VolumesActionsTest-instance-710116394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-710116394',id=45,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:41:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='371d253c57734dcfacd1e7e37116258d',ramdisk_id='',reservation_id='r-d4fwaq0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-485654311',owner_user_name='tempest-VolumesActionsTest-485654311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:41:25Z,user_data=None,user_id='c6934fedf4fb46a4b9e1495aa20a6111',uuid=1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "address": "fa:16:3e:df:41:84", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1a575-6e", "ovs_interfaceid": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Converting VIF {"id": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "address": "fa:16:3e:df:41:84", "network": {"id": "4e201e5d-9e1f-41ca-9417-8192ac42cc29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-886724615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371d253c57734dcfacd1e7e37116258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1a575-6e", "ovs_interfaceid": "8aa1a575-6e4f-4421-97f3-84373dd2e693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:41:84,bridge_name='br-int',has_traffic_filtering=True,id=8aa1a575-6e4f-4421-97f3-84373dd2e693,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1a575-6e') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG os_vif [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:41:84,bridge_name='br-int',has_traffic_filtering=True,id=8aa1a575-6e4f-4421-97f3-84373dd2e693,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1a575-6e') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8aa1a575-6e, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:43:08 user nova-compute[72818]: INFO os_vif [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:41:84,bridge_name='br-int',has_traffic_filtering=True,id=8aa1a575-6e4f-4421-97f3-84373dd2e693,network=Network(4e201e5d-9e1f-41ca-9417-8192ac42cc29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1a575-6e')
Aug 17 21:43:08 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Deleting instance files /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc_del
Aug 17 21:43:08 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Deletion of /opt/stack/data/nova/instances/1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc_del complete
Aug 17 21:43:08 user nova-compute[72818]: INFO nova.compute.manager [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 17 21:43:08 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:43:08 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Took 0.47 seconds to deallocate network for instance.
Aug 17 21:43:08 user nova-compute[72818]: DEBUG nova.compute.manager [req-a4acb3a2-f036-4394-9a91-cd6658b44eee req-8be1f1f6-4a6f-45dd-9daa-11ea4a22f85a service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Received event network-vif-deleted-8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:43:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:08 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Deleted allocations for instance 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc
Aug 17 21:43:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2b20c833-6734-42cb-b0e3-3664c8164b28 tempest-VolumesActionsTest-485654311 tempest-VolumesActionsTest-485654311-project-member] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.633s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-c7e95eb3-5b1c-42a7-85ec-b84fece205e0 req-83a2db0c-2483-47de-a91a-bc9404ef4005 service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Received event network-vif-plugged-8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c7e95eb3-5b1c-42a7-85ec-b84fece205e0 req-83a2db0c-2483-47de-a91a-bc9404ef4005 service nova] Acquiring lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c7e95eb3-5b1c-42a7-85ec-b84fece205e0 req-83a2db0c-2483-47de-a91a-bc9404ef4005 service nova] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c7e95eb3-5b1c-42a7-85ec-b84fece205e0 req-83a2db0c-2483-47de-a91a-bc9404ef4005 service nova] Lock "1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:09 user nova-compute[72818]: DEBUG nova.compute.manager [req-c7e95eb3-5b1c-42a7-85ec-b84fece205e0 req-83a2db0c-2483-47de-a91a-bc9404ef4005 service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] No waiting events found dispatching network-vif-plugged-8aa1a575-6e4f-4421-97f3-84373dd2e693 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:09 user nova-compute[72818]: WARNING nova.compute.manager [req-c7e95eb3-5b1c-42a7-85ec-b84fece205e0 req-83a2db0c-2483-47de-a91a-bc9404ef4005 service nova] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Received unexpected event network-vif-plugged-8aa1a575-6e4f-4421-97f3-84373dd2e693 for instance with vm_state deleted and task_state None.
Aug 17 21:43:11 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:43:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:43:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:43:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:43:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:43:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:43:13 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:43:14 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Updating instance_info_cache with network_info: [{"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:43:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:43:14 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:43:14 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqtCYLRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:43:15 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:43:15 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:43:15 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e077a395-243d-4529-82ac-4ceed1954123]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:43:15 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[738fc892-5a1a-4fc7-8caa-730c6b28964f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038] added
Aug 17 21:43:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7679ca-b590-44b8-b4fe-d9804118aff0]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6b99d6-7138-4e15-8818-939ea68f3dc8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqtCYLRi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqtCYLRi" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[812bde41-a27f-45c3-a482-7829b476fc63]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lqtCYLRi'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[360ad6bd-7c55-41fe-9af1-a25d11d7b653]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5115e08-0773-4cef-a367-df0412258720]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:43:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:43:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9776c0-761f-4290-80e8-3a362334b6b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038, portal: 172.16.0.220,3260]
Aug 17 21:43:15 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038, portal: 172.16.0.220,3260] successful.
Aug 17 21:43:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfecfa0-e5eb-42a6-815b-0ecd6e1bcbcf]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[246b6afb-d928-4100-8f7f-66d86fc154f7]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:43:15 user nova-compute[72818]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 (non-flash)
Aug 17 21:43:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:43:15 user nova-compute[72818]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 (non-flash)
Aug 17 21:43:15 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd20eea3-4ad8-4c1f-a0f7-ecd89f6ceccf]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:43:15 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:43:16 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:43:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqtCYLRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:43:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:43:16 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26636393335613833', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:43:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636393335613833', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:43:16 user nova-compute[72818]: DEBUG nova.objects.instance [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'flavor' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:43:16 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:43:16 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:43:16 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:43:16 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:43:16 user nova-compute[72818]:   <serial>20e5a393-0674-49a6-86fe-bd914cb8d038</serial>
Aug 17 21:43:16 user nova-compute[72818]: </disk>
Aug 17 21:43:16 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:43:16 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:43:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No VIF found with MAC fa:16:3e:60:8b:76, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308582.2253523, 68b338a7-f643-4635-b2af-d4170504589d => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:43:17 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 68b338a7-f643-4635-b2af-d4170504589d] VM Stopped (Lifecycle Event)
Aug 17 21:43:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-313813ba-9267-4880-80aa-c427b5d10766 None None] [instance: 68b338a7-f643-4635-b2af-d4170504589d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-08404938-2bc7-42d9-bf81-b0b407235462 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.097s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:43:18 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:43:18 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:43:18 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8144MB free_disk=25.336585998535156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 01162bf0-7e42-4926-95e3-a286827e16bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 2551d322-916b-4b81-9e50-7c174108b741 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:43:18 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:43:19 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:43:19 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:43:19 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:43:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:21 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:43:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:43:21 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:43:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:23 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308588.0338004, 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:43:23 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] VM Stopped (Lifecycle Event)
Aug 17 21:43:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-32bf8588-2474-4cc5-b0b7-d28d3b10e678 None None] [instance: 1a9ae8bc-aa1d-48c9-8c1a-89750f8419dc] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:43:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:43:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "01162bf0-7e42-4926-95e3-a286827e16bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "01162bf0-7e42-4926-95e3-a286827e16bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:32 user nova-compute[72818]: INFO nova.compute.manager [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Terminating instance
Aug 17 21:43:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-aab87957-c2b5-43a5-8c5f-5fb2f752c95c req-ab920fb9-6af4-4d07-9254-21a2dda7490b service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Received event network-vif-unplugged-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-aab87957-c2b5-43a5-8c5f-5fb2f752c95c req-ab920fb9-6af4-4d07-9254-21a2dda7490b service nova] Acquiring lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-aab87957-c2b5-43a5-8c5f-5fb2f752c95c req-ab920fb9-6af4-4d07-9254-21a2dda7490b service nova] Lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-aab87957-c2b5-43a5-8c5f-5fb2f752c95c req-ab920fb9-6af4-4d07-9254-21a2dda7490b service nova] Lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-aab87957-c2b5-43a5-8c5f-5fb2f752c95c req-ab920fb9-6af4-4d07-9254-21a2dda7490b service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] No waiting events found dispatching network-vif-unplugged-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-aab87957-c2b5-43a5-8c5f-5fb2f752c95c req-ab920fb9-6af4-4d07-9254-21a2dda7490b service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Received event network-vif-unplugged-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:43:32 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Instance destroyed successfully.
Aug 17 21:43:32 user nova-compute[72818]: DEBUG nova.objects.instance [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'resources' on Instance uuid 01162bf0-7e42-4926-95e3-a286827e16bf {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:43:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:37:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1995112111',display_name='tempest-AttachVolumeNegativeTest-server-1995112111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1995112111',id=38,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlOfLYIORyZKi9eUvA12dywHM7TNuuB+HKGN8+QSik2o1S0p5fMn8iDXNUEtdFZhECPGFFss3vQOxz1J2KAso/FsaI2Vb1rpd0oL0EY0ge3ILIOLGzbkUGGnZm/GrB6QA==',key_name='tempest-keypair-121627058',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:37:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ffd845455a84fbf9e1517ffe2af001c',ramdisk_id='',reservation_id='r-kpfstmfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2048664550',owner_user_name='tempest-AttachVolumeNegativeTest-2048664550-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:37:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d025fb1e3974f5d91a7086343bbe5e1',uuid=01162bf0-7e42-4926-95e3-a286827e16bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:43:33 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converting VIF {"id": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "address": "fa:16:3e:22:27:7a", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63bea4d-b5", "ovs_interfaceid": "f63bea4d-b5cf-4137-b058-4d3a0f0a2063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:43:33 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:27:7a,bridge_name='br-int',has_traffic_filtering=True,id=f63bea4d-b5cf-4137-b058-4d3a0f0a2063,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63bea4d-b5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:43:33 user nova-compute[72818]: DEBUG os_vif [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:27:7a,bridge_name='br-int',has_traffic_filtering=True,id=f63bea4d-b5cf-4137-b058-4d3a0f0a2063,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63bea4d-b5') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:43:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf63bea4d-b5, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:43:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:43:33 user nova-compute[72818]: INFO os_vif [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:27:7a,bridge_name='br-int',has_traffic_filtering=True,id=f63bea4d-b5cf-4137-b058-4d3a0f0a2063,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63bea4d-b5')
Aug 17 21:43:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Deleting instance files /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf_del
Aug 17 21:43:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Deletion of /opt/stack/data/nova/instances/01162bf0-7e42-4926-95e3-a286827e16bf_del complete
Aug 17 21:43:33 user nova-compute[72818]: INFO nova.compute.manager [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 21:43:33 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:43:33 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:43:33 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:43:33 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:43:33 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Took 0.88 seconds to deallocate network for instance.
Aug 17 21:43:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:34 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:43:34 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:43:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:34 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Deleted allocations for instance 01162bf0-7e42-4926-95e3-a286827e16bf
Aug 17 21:43:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-abc4cdcd-7f40-490f-a171-01a3894f776e tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "01162bf0-7e42-4926-95e3-a286827e16bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.125s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-7201bfba-17c4-4113-bfc5-31d242275305 req-cff6dcaf-1f32-4d1e-b184-61b6c3f0962b service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Received event network-vif-plugged-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7201bfba-17c4-4113-bfc5-31d242275305 req-cff6dcaf-1f32-4d1e-b184-61b6c3f0962b service nova] Acquiring lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7201bfba-17c4-4113-bfc5-31d242275305 req-cff6dcaf-1f32-4d1e-b184-61b6c3f0962b service nova] Lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7201bfba-17c4-4113-bfc5-31d242275305 req-cff6dcaf-1f32-4d1e-b184-61b6c3f0962b service nova] Lock "01162bf0-7e42-4926-95e3-a286827e16bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-7201bfba-17c4-4113-bfc5-31d242275305 req-cff6dcaf-1f32-4d1e-b184-61b6c3f0962b service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] No waiting events found dispatching network-vif-plugged-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:34 user nova-compute[72818]: WARNING nova.compute.manager [req-7201bfba-17c4-4113-bfc5-31d242275305 req-cff6dcaf-1f32-4d1e-b184-61b6c3f0962b service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Received unexpected event network-vif-plugged-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 for instance with vm_state deleted and task_state None.
Aug 17 21:43:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-7201bfba-17c4-4113-bfc5-31d242275305 req-cff6dcaf-1f32-4d1e-b184-61b6c3f0962b service nova] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Received event network-vif-deleted-f63bea4d-b5cf-4137-b058-4d3a0f0a2063 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:47 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308612.9859428, 01162bf0-7e42-4926-95e3-a286827e16bf => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:43:47 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] VM Stopped (Lifecycle Event)
Aug 17 21:43:48 user nova-compute[72818]: DEBUG nova.compute.manager [None req-fa4043a4-f748-440d-a689-a23d7aba809f None None] [instance: 01162bf0-7e42-4926-95e3-a286827e16bf] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:43:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:49 user nova-compute[72818]: INFO nova.compute.manager [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Detaching volume 20e5a393-0674-49a6-86fe-bd914cb8d038
Aug 17 21:43:49 user nova-compute[72818]: INFO nova.virt.block_device [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attempting to driver detach volume 20e5a393-0674-49a6-86fe-bd914cb8d038 from mountpoint /dev/vdb
Aug 17 21:43:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Attempting to detach device vdb from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:43:49 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:43:49 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:43:49 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:43:49 user nova-compute[72818]:   <serial>20e5a393-0674-49a6-86fe-bd914cb8d038</serial>
Aug 17 21:43:49 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:43:49 user nova-compute[72818]: </disk>
Aug 17 21:43:49 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:43:49 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Successfully detached device vdb from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the persistent domain config.
Aug 17 21:43:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:43:49 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:43:49 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:43:49 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:43:49 user nova-compute[72818]:   <serial>20e5a393-0674-49a6-86fe-bd914cb8d038</serial>
Aug 17 21:43:49 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:43:49 user nova-compute[72818]: </disk>
Aug 17 21:43:49 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308629.6429276, ff7cf0b9-d00e-4595-a279-79d9e7a4801d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:43:49 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Successfully detached device vdb from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the live domain config.
Aug 17 21:43:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqtCYLRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:43:49 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1518a812-b8c8-4ce5-b54f-6db90cd9ba8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[792879ab-5017-437f-9548-41c93ed18903]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:43:49 user nova-compute[72818]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 (non-flash)
Aug 17 21:43:49 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:43:49 user nova-compute[72818]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 (non-flash)
Aug 17 21:43:49 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f2876dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038'): ({'sdc'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Removing single pathed devices sdc {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00e5645-875e-441d-89f9-e88d70e3e802]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d273523-9789-4da7-bdb5-380909efbb76]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Flushing IO for device /dev/sdc {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93cce51-bda6-489c-9dd3-0774b6ea32e0]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d13e7f3-cc6b-4746-8d5e-06adcd4cb84d]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0f7e70-d156-454f-b800-823cff9f5d12]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e391e7-b5bb-4508-b923-dcb0dd4c141a]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038, portal: 172.16.0.220,3260]
Aug 17 21:43:49 user nova-compute[72818]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038, portal: 172.16.0.220,3260] successful.
Aug 17 21:43:49 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e5a393-0674-49a6-86fe-bd914cb8d038 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5118f343-5f35-471a-8962-6342d724af69]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] <== disconnect_volume: return (295ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:43:49 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:43:50 user nova-compute[72818]: INFO nova.compute.claims [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Claim successful on node user
Aug 17 21:43:50 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG nova.network.neutron [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG nova.objects.instance [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'flavor' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:43:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:43:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-978f8795-6496-47a8-8665-2d9f3fd80017 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.839s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG nova.policy [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1329fecf5b2493ab0bea875e2151c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871c508928564101ad0a1dab7a890f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:43:50 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Creating image(s)
Aug 17 21:43:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "/opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:50 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "/opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "/opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.168s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.170s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk 1073741824" returned: 0 in 0.052s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.198s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Cannot resize image /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG nova.objects.instance [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lazy-loading 'migration_context' on Instance uuid d60e8d2b-3882-4c46-99cf-4fad2acf6897 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Ensure instance console log exists: /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:51 user nova-compute[72818]: DEBUG nova.network.neutron [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Successfully created port: 79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:43:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Successfully updated port: 79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:43:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "refresh_cache-d60e8d2b-3882-4c46-99cf-4fad2acf6897" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:43:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquired lock "refresh_cache-d60e8d2b-3882-4c46-99cf-4fad2acf6897" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:43:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:43:52 user nova-compute[72818]: DEBUG nova.compute.manager [req-289130de-2465-4def-9ebe-99d93c568f97 req-1d612786-6616-4322-b23e-0c8bcd7b369c service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Received event network-changed-79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:52 user nova-compute[72818]: DEBUG nova.compute.manager [req-289130de-2465-4def-9ebe-99d93c568f97 req-1d612786-6616-4322-b23e-0c8bcd7b369c service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Refreshing instance network info cache due to event network-changed-79fb84b1-9e06-4002-8b96-3f966a12639f. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:43:52 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-289130de-2465-4def-9ebe-99d93c568f97 req-1d612786-6616-4322-b23e-0c8bcd7b369c service nova] Acquiring lock "refresh_cache-d60e8d2b-3882-4c46-99cf-4fad2acf6897" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:43:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:43:52 user nova-compute[72818]: DEBUG nova.network.neutron [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Updating instance_info_cache with network_info: [{"id": "79fb84b1-9e06-4002-8b96-3f966a12639f", "address": "fa:16:3e:17:04:1c", "network": {"id": "96bcd9a6-7e50-4116-83d4-462035198c52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-203350382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871c508928564101ad0a1dab7a890f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fb84b1-9e", "ovs_interfaceid": "79fb84b1-9e06-4002-8b96-3f966a12639f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Releasing lock "refresh_cache-d60e8d2b-3882-4c46-99cf-4fad2acf6897" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.compute.manager [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Instance network_info: |[{"id": "79fb84b1-9e06-4002-8b96-3f966a12639f", "address": "fa:16:3e:17:04:1c", "network": {"id": "96bcd9a6-7e50-4116-83d4-462035198c52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-203350382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871c508928564101ad0a1dab7a890f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fb84b1-9e", "ovs_interfaceid": "79fb84b1-9e06-4002-8b96-3f966a12639f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-289130de-2465-4def-9ebe-99d93c568f97 req-1d612786-6616-4322-b23e-0c8bcd7b369c service nova] Acquired lock "refresh_cache-d60e8d2b-3882-4c46-99cf-4fad2acf6897" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.network.neutron [req-289130de-2465-4def-9ebe-99d93c568f97 req-1d612786-6616-4322-b23e-0c8bcd7b369c service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Refreshing network info cache for port 79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Start _get_guest_xml network_info=[{"id": "79fb84b1-9e06-4002-8b96-3f966a12639f", "address": "fa:16:3e:17:04:1c", "network": {"id": "96bcd9a6-7e50-4116-83d4-462035198c52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-203350382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871c508928564101ad0a1dab7a890f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fb84b1-9e", "ovs_interfaceid": "79fb84b1-9e06-4002-8b96-3f966a12639f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:53 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:43:53 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1993215180',display_name='tempest-TestServerVolumeAttachmentScenario-server-1993215180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1993215180',id=47,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB9HabASo4AtUAoKvW95I2Yb4oCzp+ni3w4R+8vbCvQ2yJDJfvbmpZBmyEkf16dtbt6MZBzeWfuGtwoWW8grWsXats4TJGqpIw0E12CsXCv5QxI8wL42E29U2J5h2TIcA==',key_name='tempest-keypair-1042673641',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871c508928564101ad0a1dab7a890f49',ramdisk_id='',reservation_id='r-t7wf9k1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1671956283',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1671956283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1329fecf5b2493ab0bea875e2151c34',uuid=d60e8d2b-3882-4c46-99cf-4fad2acf6897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79fb84b1-9e06-4002-8b96-3f966a12639f", "address": "fa:16:3e:17:04:1c", "network": {"id": "96bcd9a6-7e50-4116-83d4-462035198c52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-203350382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871c508928564101ad0a1dab7a890f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fb84b1-9e", "ovs_interfaceid": "79fb84b1-9e06-4002-8b96-3f966a12639f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Converting VIF {"id": "79fb84b1-9e06-4002-8b96-3f966a12639f", "address": "fa:16:3e:17:04:1c", "network": {"id": "96bcd9a6-7e50-4116-83d4-462035198c52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-203350382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871c508928564101ad0a1dab7a890f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fb84b1-9e", "ovs_interfaceid": "79fb84b1-9e06-4002-8b96-3f966a12639f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:04:1c,bridge_name='br-int',has_traffic_filtering=True,id=79fb84b1-9e06-4002-8b96-3f966a12639f,network=Network(96bcd9a6-7e50-4116-83d4-462035198c52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fb84b1-9e') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.objects.instance [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lazy-loading 'pci_devices' on Instance uuid d60e8d2b-3882-4c46-99cf-4fad2acf6897 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:43:53 user nova-compute[72818]:   <uuid>d60e8d2b-3882-4c46-99cf-4fad2acf6897</uuid>
Aug 17 21:43:53 user nova-compute[72818]:   <name>instance-0000002f</name>
Aug 17 21:43:53 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:43:53 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:43:53 user nova-compute[72818]:   <metadata>
Aug 17 21:43:53 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:43:53 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:43:53 user nova-compute[72818]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1993215180</nova:name>
Aug 17 21:43:53 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:43:53</nova:creationTime>
Aug 17 21:43:53 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:43:53 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:43:53 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:43:53 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:43:53 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:43:53 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:43:53 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:43:53 user nova-compute[72818]:       <nova:owner>
Aug 17 21:43:53 user nova-compute[72818]:         <nova:user uuid="b1329fecf5b2493ab0bea875e2151c34">tempest-TestServerVolumeAttachmentScenario-1671956283-project-member</nova:user>
Aug 17 21:43:53 user nova-compute[72818]:         <nova:project uuid="871c508928564101ad0a1dab7a890f49">tempest-TestServerVolumeAttachmentScenario-1671956283</nova:project>
Aug 17 21:43:53 user nova-compute[72818]:       </nova:owner>
Aug 17 21:43:53 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:43:53 user nova-compute[72818]:       <nova:ports>
Aug 17 21:43:53 user nova-compute[72818]:         <nova:port uuid="79fb84b1-9e06-4002-8b96-3f966a12639f">
Aug 17 21:43:53 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 21:43:53 user nova-compute[72818]:         </nova:port>
Aug 17 21:43:53 user nova-compute[72818]:       </nova:ports>
Aug 17 21:43:53 user nova-compute[72818]:     </nova:instance>
Aug 17 21:43:53 user nova-compute[72818]:   </metadata>
Aug 17 21:43:53 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:43:53 user nova-compute[72818]:     <system>
Aug 17 21:43:53 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:43:53 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:43:53 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:43:53 user nova-compute[72818]:       <entry name="serial">d60e8d2b-3882-4c46-99cf-4fad2acf6897</entry>
Aug 17 21:43:53 user nova-compute[72818]:       <entry name="uuid">d60e8d2b-3882-4c46-99cf-4fad2acf6897</entry>
Aug 17 21:43:53 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:43:53 user nova-compute[72818]:     </system>
Aug 17 21:43:53 user nova-compute[72818]:   </sysinfo>
Aug 17 21:43:53 user nova-compute[72818]:   <os>
Aug 17 21:43:53 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:43:53 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:43:53 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:43:53 user nova-compute[72818]:   </os>
Aug 17 21:43:53 user nova-compute[72818]:   <features>
Aug 17 21:43:53 user nova-compute[72818]:     <acpi/>
Aug 17 21:43:53 user nova-compute[72818]:     <apic/>
Aug 17 21:43:53 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:43:53 user nova-compute[72818]:   </features>
Aug 17 21:43:53 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:43:53 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:43:53 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:43:53 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:43:53 user nova-compute[72818]:   </clock>
Aug 17 21:43:53 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:43:53 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:43:53 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:43:53 user nova-compute[72818]:   </cpu>
Aug 17 21:43:53 user nova-compute[72818]:   <devices>
Aug 17 21:43:53 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:43:53 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:43:53 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk"/>
Aug 17 21:43:53 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:43:53 user nova-compute[72818]:     </disk>
Aug 17 21:43:53 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:43:53 user nova-compute[72818]:       <mac address="fa:16:3e:17:04:1c"/>
Aug 17 21:43:53 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:43:53 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:43:53 user nova-compute[72818]:       <target dev="tap79fb84b1-9e"/>
Aug 17 21:43:53 user nova-compute[72818]:     </interface>
Aug 17 21:43:53 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:43:53 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/console.log" append="off"/>
Aug 17 21:43:53 user nova-compute[72818]:     </serial>
Aug 17 21:43:53 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:43:53 user nova-compute[72818]:     <video>
Aug 17 21:43:53 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:43:53 user nova-compute[72818]:     </video>
Aug 17 21:43:53 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:43:53 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:43:53 user nova-compute[72818]:     </rng>
Aug 17 21:43:53 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:43:53 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:43:53 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:43:53 user nova-compute[72818]:     </memballoon>
Aug 17 21:43:53 user nova-compute[72818]:   </devices>
Aug 17 21:43:53 user nova-compute[72818]: </domain>
Aug 17 21:43:53 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1993215180',display_name='tempest-TestServerVolumeAttachmentScenario-server-1993215180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1993215180',id=47,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB9HabASo4AtUAoKvW95I2Yb4oCzp+ni3w4R+8vbCvQ2yJDJfvbmpZBmyEkf16dtbt6MZBzeWfuGtwoWW8grWsXats4TJGqpIw0E12CsXCv5QxI8wL42E29U2J5h2TIcA==',key_name='tempest-keypair-1042673641',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871c508928564101ad0a1dab7a890f49',ramdisk_id='',reservation_id='r-t7wf9k1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1671956283',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1671956283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1329fecf5b2493ab0bea875e2151c34',uuid=d60e8d2b-3882-4c46-99cf-4fad2acf6897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79fb84b1-9e06-4002-8b96-3f966a12639f", "address": "fa:16:3e:17:04:1c", "network": {"id": "96bcd9a6-7e50-4116-83d4-462035198c52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-203350382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871c508928564101ad0a1dab7a890f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fb84b1-9e", "ovs_interfaceid": "79fb84b1-9e06-4002-8b96-3f966a12639f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Converting VIF {"id": "79fb84b1-9e06-4002-8b96-3f966a12639f", "address": "fa:16:3e:17:04:1c", "network": {"id": "96bcd9a6-7e50-4116-83d4-462035198c52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-203350382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871c508928564101ad0a1dab7a890f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fb84b1-9e", "ovs_interfaceid": "79fb84b1-9e06-4002-8b96-3f966a12639f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:04:1c,bridge_name='br-int',has_traffic_filtering=True,id=79fb84b1-9e06-4002-8b96-3f966a12639f,network=Network(96bcd9a6-7e50-4116-83d4-462035198c52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fb84b1-9e') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG os_vif [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:04:1c,bridge_name='br-int',has_traffic_filtering=True,id=79fb84b1-9e06-4002-8b96-3f966a12639f,network=Network(96bcd9a6-7e50-4116-83d4-462035198c52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fb84b1-9e') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79fb84b1-9e, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79fb84b1-9e, col_values=(('external_ids', {'iface-id': '79fb84b1-9e06-4002-8b96-3f966a12639f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:04:1c', 'vm-uuid': 'd60e8d2b-3882-4c46-99cf-4fad2acf6897'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:53 user nova-compute[72818]: INFO os_vif [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:04:1c,bridge_name='br-int',has_traffic_filtering=True,id=79fb84b1-9e06-4002-8b96-3f966a12639f,network=Network(96bcd9a6-7e50-4116-83d4-462035198c52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fb84b1-9e')
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] No VIF found with MAC fa:16:3e:17:04:1c, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.network.neutron [req-289130de-2465-4def-9ebe-99d93c568f97 req-1d612786-6616-4322-b23e-0c8bcd7b369c service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Updated VIF entry in instance network info cache for port 79fb84b1-9e06-4002-8b96-3f966a12639f. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG nova.network.neutron [req-289130de-2465-4def-9ebe-99d93c568f97 req-1d612786-6616-4322-b23e-0c8bcd7b369c service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Updating instance_info_cache with network_info: [{"id": "79fb84b1-9e06-4002-8b96-3f966a12639f", "address": "fa:16:3e:17:04:1c", "network": {"id": "96bcd9a6-7e50-4116-83d4-462035198c52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-203350382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871c508928564101ad0a1dab7a890f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fb84b1-9e", "ovs_interfaceid": "79fb84b1-9e06-4002-8b96-3f966a12639f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:43:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-289130de-2465-4def-9ebe-99d93c568f97 req-1d612786-6616-4322-b23e-0c8bcd7b369c service nova] Releasing lock "refresh_cache-d60e8d2b-3882-4c46-99cf-4fad2acf6897" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:43:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:54 user nova-compute[72818]: DEBUG nova.compute.manager [req-6085e638-fabb-4f00-b1e9-c4f7a70acd9a req-9c5f7f23-35db-42b3-9c86-2f2f87e39fef service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Received event network-vif-plugged-79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6085e638-fabb-4f00-b1e9-c4f7a70acd9a req-9c5f7f23-35db-42b3-9c86-2f2f87e39fef service nova] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6085e638-fabb-4f00-b1e9-c4f7a70acd9a req-9c5f7f23-35db-42b3-9c86-2f2f87e39fef service nova] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6085e638-fabb-4f00-b1e9-c4f7a70acd9a req-9c5f7f23-35db-42b3-9c86-2f2f87e39fef service nova] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:54 user nova-compute[72818]: DEBUG nova.compute.manager [req-6085e638-fabb-4f00-b1e9-c4f7a70acd9a req-9c5f7f23-35db-42b3-9c86-2f2f87e39fef service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] No waiting events found dispatching network-vif-plugged-79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:54 user nova-compute[72818]: WARNING nova.compute.manager [req-6085e638-fabb-4f00-b1e9-c4f7a70acd9a req-9c5f7f23-35db-42b3-9c86-2f2f87e39fef service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Received unexpected event network-vif-plugged-79fb84b1-9e06-4002-8b96-3f966a12639f for instance with vm_state building and task_state spawning.
Aug 17 21:43:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308636.5773492, d60e8d2b-3882-4c46-99cf-4fad2acf6897 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:43:56 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] VM Resumed (Lifecycle Event)
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:43:56 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Instance spawned successfully.
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:43:56 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308636.5804646, d60e8d2b-3882-4c46-99cf-4fad2acf6897 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:43:56 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] VM Started (Lifecycle Event)
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:43:56 user nova-compute[72818]: INFO nova.compute.manager [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Took 5.70 seconds to spawn the instance on the hypervisor.
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-5301750a-7ebb-4872-b6d4-6639acbd5b11 req-14fef345-992d-4ef2-a811-3b0de8ae6840 service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Received event network-vif-plugged-79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5301750a-7ebb-4872-b6d4-6639acbd5b11 req-14fef345-992d-4ef2-a811-3b0de8ae6840 service nova] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5301750a-7ebb-4872-b6d4-6639acbd5b11 req-14fef345-992d-4ef2-a811-3b0de8ae6840 service nova] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-5301750a-7ebb-4872-b6d4-6639acbd5b11 req-14fef345-992d-4ef2-a811-3b0de8ae6840 service nova] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-5301750a-7ebb-4872-b6d4-6639acbd5b11 req-14fef345-992d-4ef2-a811-3b0de8ae6840 service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] No waiting events found dispatching network-vif-plugged-79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:43:56 user nova-compute[72818]: WARNING nova.compute.manager [req-5301750a-7ebb-4872-b6d4-6639acbd5b11 req-14fef345-992d-4ef2-a811-3b0de8ae6840 service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Received unexpected event network-vif-plugged-79fb84b1-9e06-4002-8b96-3f966a12639f for instance with vm_state building and task_state spawning.
Aug 17 21:43:56 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:43:56 user nova-compute[72818]: INFO nova.compute.manager [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Took 6.35 seconds to build instance.
Aug 17 21:43:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60ee9a39-a0d5-4104-ac60-554b4617b4b3 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.443s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:43:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:43:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-67361c83-c563-4b33-886b-79f7ee1efdda req-436567ac-8c62-4d0f-b927-1938539f8fbf service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-changed-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:04 user nova-compute[72818]: DEBUG nova.compute.manager [req-67361c83-c563-4b33-886b-79f7ee1efdda req-436567ac-8c62-4d0f-b927-1938539f8fbf service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Refreshing instance network info cache due to event network-changed-36e2738b-21a2-4fa8-8298-e03350a6fc5c. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:44:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-67361c83-c563-4b33-886b-79f7ee1efdda req-436567ac-8c62-4d0f-b927-1938539f8fbf service nova] Acquiring lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:44:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-67361c83-c563-4b33-886b-79f7ee1efdda req-436567ac-8c62-4d0f-b927-1938539f8fbf service nova] Acquired lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:44:04 user nova-compute[72818]: DEBUG nova.network.neutron [req-67361c83-c563-4b33-886b-79f7ee1efdda req-436567ac-8c62-4d0f-b927-1938539f8fbf service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Refreshing network info cache for port 36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:05 user nova-compute[72818]: INFO nova.compute.manager [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Terminating instance
Aug 17 21:44:05 user nova-compute[72818]: DEBUG nova.compute.manager [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG nova.network.neutron [req-67361c83-c563-4b33-886b-79f7ee1efdda req-436567ac-8c62-4d0f-b927-1938539f8fbf service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Updated VIF entry in instance network info cache for port 36e2738b-21a2-4fa8-8298-e03350a6fc5c. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG nova.network.neutron [req-67361c83-c563-4b33-886b-79f7ee1efdda req-436567ac-8c62-4d0f-b927-1938539f8fbf service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Updating instance_info_cache with network_info: [{"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-67361c83-c563-4b33-886b-79f7ee1efdda req-436567ac-8c62-4d0f-b927-1938539f8fbf service nova] Releasing lock "refresh_cache-8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:05 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Instance destroyed successfully.
Aug 17 21:44:05 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lazy-loading 'resources' on Instance uuid 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-675216932',display_name='tempest-TestVolumeBootPattern-server-675216932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-675216932',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvgvYY4VEzOO1hBWsb20sNrMVs8w/XTYHCJEm0Bvp0JOphCdpXxCT+2Vc1RBvadH4gKZoKMMxsPeL8omuqOhZEcjdNF9Xh2fVwAM7u4vOVW7jR4hyrsil3xbR7zmO8kpg==',key_name='tempest-TestVolumeBootPattern-782174029',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:39:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92abc22a192a44398dffe75ffae6d270',ramdisk_id='',reservation_id='r-gdc0w8hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-973058317',owner_user_name='tempest-TestVolumeBootPattern-973058317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:39:16Z,user_data=None,user_id='de902559a8794d1a8af9c0efbed4e38a',uuid=8fde6d5f-cbc4-4108-9c2c-d86ae6587a03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converting VIF {"id": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "address": "fa:16:3e:74:1c:ec", "network": {"id": "6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2042593136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92abc22a192a44398dffe75ffae6d270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e2738b-21", "ovs_interfaceid": "36e2738b-21a2-4fa8-8298-e03350a6fc5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:1c:ec,bridge_name='br-int',has_traffic_filtering=True,id=36e2738b-21a2-4fa8-8298-e03350a6fc5c,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e2738b-21') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG os_vif [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:1c:ec,bridge_name='br-int',has_traffic_filtering=True,id=36e2738b-21a2-4fa8-8298-e03350a6fc5c,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e2738b-21') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36e2738b-21, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:05 user nova-compute[72818]: INFO os_vif [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:1c:ec,bridge_name='br-int',has_traffic_filtering=True,id=36e2738b-21a2-4fa8-8298-e03350a6fc5c,network=Network(6fe34e5d-3d3e-42c4-8dd7-3acdb44d9654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e2738b-21')
Aug 17 21:44:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBJncWFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:44:05 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:44:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b6cce2-6b0b-4afe-aff3-4880731f9589]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcd635c-2849-4f2c-a7a5-c6c8b64299cb]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:44:05 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 (non-flash)
Aug 17 21:44:05 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f2855c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b6c0ad-f215-4d8a-adf8-ef10863d9117]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[133e4e46-3f26-4961-b569-919ae8295798]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c6be65-3077-4a66-81ec-5b686a2bc294]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:44:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f22e62a-849b-4245-bc0b-ba04dfd24850]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6c13a5d-8a12fd0e7e6ea6dc', '/dev/disk/by-id/scsi-23861313266643065', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6c13a5d') {{(pid=83620) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c87f4ec-2123-4a06-a424-1d7fd9d228b3]: (4, None) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21507e8-8712-43a0-b63f-c7bbf8a8c102]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e8af36-1c26-4e7a-9394-6b4295d999e8]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260]
Aug 17 21:44:06 user nova-compute[72818]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1, portal: 172.16.0.220,3260] successful.
Aug 17 21:44:06 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68a9d689-8136-4eca-8e34-4125f727c3e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd2208c-51e1-4d2d-bf2c-9b3f50deba62]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] <== disconnect_volume: return (319ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:44:06 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Deleting instance files /opt/stack/data/nova/instances/8fde6d5f-cbc4-4108-9c2c-d86ae6587a03_del
Aug 17 21:44:06 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Deletion of /opt/stack/data/nova/instances/8fde6d5f-cbc4-4108-9c2c-d86ae6587a03_del complete
Aug 17 21:44:06 user nova-compute[72818]: INFO nova.compute.manager [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:44:06 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Took 0.49 seconds to deallocate network for instance.
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-e0735c5b-8832-4bf0-b0fe-23c4e3abbd01 req-b66f54ba-baae-4895-9a2b-bfeea734ac59 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-vif-deleted-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:06 user nova-compute[72818]: INFO nova.compute.manager [req-e0735c5b-8832-4bf0-b0fe-23c4e3abbd01 req-b66f54ba-baae-4895-9a2b-bfeea734ac59 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Neutron deleted interface 36e2738b-21a2-4fa8-8298-e03350a6fc5c; detaching it from the instance and deleting it from the info cache
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.network.neutron [req-e0735c5b-8832-4bf0-b0fe-23c4e3abbd01 req-b66f54ba-baae-4895-9a2b-bfeea734ac59 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-e0735c5b-8832-4bf0-b0fe-23c4e3abbd01 req-b66f54ba-baae-4895-9a2b-bfeea734ac59 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Detach interface failed, port_id=36e2738b-21a2-4fa8-8298-e03350a6fc5c, reason: Instance 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03 could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-vif-unplugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Acquiring lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] No waiting events found dispatching network-vif-unplugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-vif-unplugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Acquiring lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] No waiting events found dispatching network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:44:06 user nova-compute[72818]: WARNING nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received unexpected event network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c for instance with vm_state active and task_state deleting.
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Acquiring lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] No waiting events found dispatching network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:44:06 user nova-compute[72818]: WARNING nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received unexpected event network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c for instance with vm_state active and task_state deleting.
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Acquiring lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] No waiting events found dispatching network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:44:06 user nova-compute[72818]: WARNING nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received unexpected event network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c for instance with vm_state active and task_state deleting.
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-vif-unplugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Acquiring lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] No waiting events found dispatching network-vif-unplugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-vif-unplugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received event network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Acquiring lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:06 user nova-compute[72818]: DEBUG nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] No waiting events found dispatching network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:44:06 user nova-compute[72818]: WARNING nova.compute.manager [req-484984bb-6745-4c06-b092-ae12a01e9a35 req-2dfc185e-1b69-46bb-a6c8-3c03ce187739 service nova] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Received unexpected event network-vif-plugged-36e2738b-21a2-4fa8-8298-e03350a6fc5c for instance with vm_state active and task_state deleting.
Aug 17 21:44:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:07 user nova-compute[72818]: INFO nova.compute.manager [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Took 0.87 seconds to detach 1 volumes for instance.
Aug 17 21:44:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:07 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:44:07 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:44:07 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:44:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:07 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Deleted allocations for instance 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03
Aug 17 21:44:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8007310a-2342-4e9e-8775-0f19221cabaf tempest-TestVolumeBootPattern-973058317 tempest-TestVolumeBootPattern-973058317-project-member] Lock "8fde6d5f-cbc4-4108-9c2c-d86ae6587a03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.940s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:11 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:44:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:44:14 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:44:14 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:44:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:44:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:44:14 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:44:15 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updating instance_info_cache with network_info: [{"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:44:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:44:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:44:15 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:44:15 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:44:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:16 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:44:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:16 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:44:16 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:17 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:18 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:44:18 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:44:19 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8219MB free_disk=25.040645599365234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:44:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:19 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:44:19 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 2551d322-916b-4b81-9e50-7c174108b741 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:44:19 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:44:19 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:44:19 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:44:19 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:44:19 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:44:19 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:44:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:20 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308645.766319, 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:44:20 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] VM Stopped (Lifecycle Event)
Aug 17 21:44:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c3b2e2fe-cd84-41eb-8f08-f9bb7345e633 None None] [instance: 8fde6d5f-cbc4-4108-9c2c-d86ae6587a03] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:44:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:23 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:44:23 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:44:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:44:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:44:28 user nova-compute[72818]: INFO nova.compute.claims [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Claim successful on node user
Aug 17 21:44:28 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG nova.network.neutron [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:44:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:44:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG nova.policy [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d025fb1e3974f5d91a7086343bbe5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffd845455a84fbf9e1517ffe2af001c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:44:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Creating image(s)
Aug 17 21:44:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "/opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "/opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.295s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.205s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk 1073741824" returned: 0 in 0.062s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.199s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Successfully created port: 326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Cannot resize image /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG nova.objects.instance [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'migration_context' on Instance uuid 7c1f5584-1f4a-4c09-80ba-774d013ea1bd {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Ensure instance console log exists: /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Successfully updated port: 326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "refresh_cache-7c1f5584-1f4a-4c09-80ba-774d013ea1bd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquired lock "refresh_cache-7c1f5584-1f4a-4c09-80ba-774d013ea1bd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-2a3cc75e-9675-4c6d-bce8-834c8266acb8 req-75b003d7-3b33-4f45-b270-34a878079ad6 service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Received event network-changed-326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-2a3cc75e-9675-4c6d-bce8-834c8266acb8 req-75b003d7-3b33-4f45-b270-34a878079ad6 service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Refreshing instance network info cache due to event network-changed-326cae3e-69af-488f-9451-59f04fff1402. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2a3cc75e-9675-4c6d-bce8-834c8266acb8 req-75b003d7-3b33-4f45-b270-34a878079ad6 service nova] Acquiring lock "refresh_cache-7c1f5584-1f4a-4c09-80ba-774d013ea1bd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Updating instance_info_cache with network_info: [{"id": "326cae3e-69af-488f-9451-59f04fff1402", "address": "fa:16:3e:76:53:eb", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326cae3e-69", "ovs_interfaceid": "326cae3e-69af-488f-9451-59f04fff1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Releasing lock "refresh_cache-7c1f5584-1f4a-4c09-80ba-774d013ea1bd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Instance network_info: |[{"id": "326cae3e-69af-488f-9451-59f04fff1402", "address": "fa:16:3e:76:53:eb", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326cae3e-69", "ovs_interfaceid": "326cae3e-69af-488f-9451-59f04fff1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2a3cc75e-9675-4c6d-bce8-834c8266acb8 req-75b003d7-3b33-4f45-b270-34a878079ad6 service nova] Acquired lock "refresh_cache-7c1f5584-1f4a-4c09-80ba-774d013ea1bd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.network.neutron [req-2a3cc75e-9675-4c6d-bce8-834c8266acb8 req-75b003d7-3b33-4f45-b270-34a878079ad6 service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Refreshing network info cache for port 326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Start _get_guest_xml network_info=[{"id": "326cae3e-69af-488f-9451-59f04fff1402", "address": "fa:16:3e:76:53:eb", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326cae3e-69", "ovs_interfaceid": "326cae3e-69af-488f-9451-59f04fff1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:44:30 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:44:30 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1650606121',display_name='tempest-AttachVolumeNegativeTest-server-1650606121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1650606121',id=48,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHsA8twxBINebilZqZU75JyIiM27NmK8LOxHulimMd3ZfggAFXP+djxmoMV3mqnX8ow9NDQBUgEK2CRgk+OTUz+9bTIu5V65LERPAoSGxM7S+2u6heHrkHKd7xAT03oug==',key_name='tempest-keypair-271330191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ffd845455a84fbf9e1517ffe2af001c',ramdisk_id='',reservation_id='r-ola7cu5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2048664550',owner_user_name='tempest-AttachVolumeNegativeTest-2048664550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d025fb1e3974f5d91a7086343bbe5e1',uuid=7c1f5584-1f4a-4c09-80ba-774d013ea1bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "326cae3e-69af-488f-9451-59f04fff1402", "address": "fa:16:3e:76:53:eb", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326cae3e-69", "ovs_interfaceid": "326cae3e-69af-488f-9451-59f04fff1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converting VIF {"id": "326cae3e-69af-488f-9451-59f04fff1402", "address": "fa:16:3e:76:53:eb", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326cae3e-69", "ovs_interfaceid": "326cae3e-69af-488f-9451-59f04fff1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:53:eb,bridge_name='br-int',has_traffic_filtering=True,id=326cae3e-69af-488f-9451-59f04fff1402,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326cae3e-69') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.objects.instance [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c1f5584-1f4a-4c09-80ba-774d013ea1bd {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:44:30 user nova-compute[72818]:   <uuid>7c1f5584-1f4a-4c09-80ba-774d013ea1bd</uuid>
Aug 17 21:44:30 user nova-compute[72818]:   <name>instance-00000030</name>
Aug 17 21:44:30 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:44:30 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:44:30 user nova-compute[72818]:   <metadata>
Aug 17 21:44:30 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:44:30 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:44:30 user nova-compute[72818]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1650606121</nova:name>
Aug 17 21:44:30 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:44:30</nova:creationTime>
Aug 17 21:44:30 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:44:30 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:44:30 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:44:30 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:44:30 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:44:30 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:44:30 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:44:30 user nova-compute[72818]:       <nova:owner>
Aug 17 21:44:30 user nova-compute[72818]:         <nova:user uuid="4d025fb1e3974f5d91a7086343bbe5e1">tempest-AttachVolumeNegativeTest-2048664550-project-member</nova:user>
Aug 17 21:44:30 user nova-compute[72818]:         <nova:project uuid="7ffd845455a84fbf9e1517ffe2af001c">tempest-AttachVolumeNegativeTest-2048664550</nova:project>
Aug 17 21:44:30 user nova-compute[72818]:       </nova:owner>
Aug 17 21:44:30 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:44:30 user nova-compute[72818]:       <nova:ports>
Aug 17 21:44:30 user nova-compute[72818]:         <nova:port uuid="326cae3e-69af-488f-9451-59f04fff1402">
Aug 17 21:44:30 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 21:44:30 user nova-compute[72818]:         </nova:port>
Aug 17 21:44:30 user nova-compute[72818]:       </nova:ports>
Aug 17 21:44:30 user nova-compute[72818]:     </nova:instance>
Aug 17 21:44:30 user nova-compute[72818]:   </metadata>
Aug 17 21:44:30 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:44:30 user nova-compute[72818]:     <system>
Aug 17 21:44:30 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:44:30 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:44:30 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:44:30 user nova-compute[72818]:       <entry name="serial">7c1f5584-1f4a-4c09-80ba-774d013ea1bd</entry>
Aug 17 21:44:30 user nova-compute[72818]:       <entry name="uuid">7c1f5584-1f4a-4c09-80ba-774d013ea1bd</entry>
Aug 17 21:44:30 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:44:30 user nova-compute[72818]:     </system>
Aug 17 21:44:30 user nova-compute[72818]:   </sysinfo>
Aug 17 21:44:30 user nova-compute[72818]:   <os>
Aug 17 21:44:30 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:44:30 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:44:30 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:44:30 user nova-compute[72818]:   </os>
Aug 17 21:44:30 user nova-compute[72818]:   <features>
Aug 17 21:44:30 user nova-compute[72818]:     <acpi/>
Aug 17 21:44:30 user nova-compute[72818]:     <apic/>
Aug 17 21:44:30 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:44:30 user nova-compute[72818]:   </features>
Aug 17 21:44:30 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:44:30 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:44:30 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:44:30 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:44:30 user nova-compute[72818]:   </clock>
Aug 17 21:44:30 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:44:30 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:44:30 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:44:30 user nova-compute[72818]:   </cpu>
Aug 17 21:44:30 user nova-compute[72818]:   <devices>
Aug 17 21:44:30 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:44:30 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:44:30 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk"/>
Aug 17 21:44:30 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:44:30 user nova-compute[72818]:     </disk>
Aug 17 21:44:30 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:44:30 user nova-compute[72818]:       <mac address="fa:16:3e:76:53:eb"/>
Aug 17 21:44:30 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:44:30 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:44:30 user nova-compute[72818]:       <target dev="tap326cae3e-69"/>
Aug 17 21:44:30 user nova-compute[72818]:     </interface>
Aug 17 21:44:30 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:44:30 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/console.log" append="off"/>
Aug 17 21:44:30 user nova-compute[72818]:     </serial>
Aug 17 21:44:30 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:44:30 user nova-compute[72818]:     <video>
Aug 17 21:44:30 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:44:30 user nova-compute[72818]:     </video>
Aug 17 21:44:30 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:44:30 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:44:30 user nova-compute[72818]:     </rng>
Aug 17 21:44:30 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:44:30 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:44:30 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:44:30 user nova-compute[72818]:     </memballoon>
Aug 17 21:44:30 user nova-compute[72818]:   </devices>
Aug 17 21:44:30 user nova-compute[72818]: </domain>
Aug 17 21:44:30 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1650606121',display_name='tempest-AttachVolumeNegativeTest-server-1650606121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1650606121',id=48,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHsA8twxBINebilZqZU75JyIiM27NmK8LOxHulimMd3ZfggAFXP+djxmoMV3mqnX8ow9NDQBUgEK2CRgk+OTUz+9bTIu5V65LERPAoSGxM7S+2u6heHrkHKd7xAT03oug==',key_name='tempest-keypair-271330191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ffd845455a84fbf9e1517ffe2af001c',ramdisk_id='',reservation_id='r-ola7cu5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2048664550',owner_user_name='tempest-AttachVolumeNegativeTest-2048664550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d025fb1e3974f5d91a7086343bbe5e1',uuid=7c1f5584-1f4a-4c09-80ba-774d013ea1bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "326cae3e-69af-488f-9451-59f04fff1402", "address": "fa:16:3e:76:53:eb", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326cae3e-69", "ovs_interfaceid": "326cae3e-69af-488f-9451-59f04fff1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converting VIF {"id": "326cae3e-69af-488f-9451-59f04fff1402", "address": "fa:16:3e:76:53:eb", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326cae3e-69", "ovs_interfaceid": "326cae3e-69af-488f-9451-59f04fff1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:53:eb,bridge_name='br-int',has_traffic_filtering=True,id=326cae3e-69af-488f-9451-59f04fff1402,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326cae3e-69') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG os_vif [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:53:eb,bridge_name='br-int',has_traffic_filtering=True,id=326cae3e-69af-488f-9451-59f04fff1402,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326cae3e-69') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap326cae3e-69, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap326cae3e-69, col_values=(('external_ids', {'iface-id': '326cae3e-69af-488f-9451-59f04fff1402', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:53:eb', 'vm-uuid': '7c1f5584-1f4a-4c09-80ba-774d013ea1bd'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:44:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:31 user nova-compute[72818]: INFO os_vif [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:53:eb,bridge_name='br-int',has_traffic_filtering=True,id=326cae3e-69af-488f-9451-59f04fff1402,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326cae3e-69')
Aug 17 21:44:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:44:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No VIF found with MAC fa:16:3e:76:53:eb, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:44:31 user nova-compute[72818]: DEBUG nova.network.neutron [req-2a3cc75e-9675-4c6d-bce8-834c8266acb8 req-75b003d7-3b33-4f45-b270-34a878079ad6 service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Updated VIF entry in instance network info cache for port 326cae3e-69af-488f-9451-59f04fff1402. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:44:31 user nova-compute[72818]: DEBUG nova.network.neutron [req-2a3cc75e-9675-4c6d-bce8-834c8266acb8 req-75b003d7-3b33-4f45-b270-34a878079ad6 service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Updating instance_info_cache with network_info: [{"id": "326cae3e-69af-488f-9451-59f04fff1402", "address": "fa:16:3e:76:53:eb", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326cae3e-69", "ovs_interfaceid": "326cae3e-69af-488f-9451-59f04fff1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:44:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2a3cc75e-9675-4c6d-bce8-834c8266acb8 req-75b003d7-3b33-4f45-b270-34a878079ad6 service nova] Releasing lock "refresh_cache-7c1f5584-1f4a-4c09-80ba-774d013ea1bd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:44:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4e969fe4-0ee0-43c1-ba93-0d841dfd7e2b req-c05905b1-a836-4e3f-8bf4-f865b62e0cd7 service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Received event network-vif-plugged-326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4e969fe4-0ee0-43c1-ba93-0d841dfd7e2b req-c05905b1-a836-4e3f-8bf4-f865b62e0cd7 service nova] Acquiring lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4e969fe4-0ee0-43c1-ba93-0d841dfd7e2b req-c05905b1-a836-4e3f-8bf4-f865b62e0cd7 service nova] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4e969fe4-0ee0-43c1-ba93-0d841dfd7e2b req-c05905b1-a836-4e3f-8bf4-f865b62e0cd7 service nova] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-4e969fe4-0ee0-43c1-ba93-0d841dfd7e2b req-c05905b1-a836-4e3f-8bf4-f865b62e0cd7 service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] No waiting events found dispatching network-vif-plugged-326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:44:32 user nova-compute[72818]: WARNING nova.compute.manager [req-4e969fe4-0ee0-43c1-ba93-0d841dfd7e2b req-c05905b1-a836-4e3f-8bf4-f865b62e0cd7 service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Received unexpected event network-vif-plugged-326cae3e-69af-488f-9451-59f04fff1402 for instance with vm_state building and task_state spawning.
Aug 17 21:44:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308674.476913, 7c1f5584-1f4a-4c09-80ba-774d013ea1bd => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:44:34 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] VM Resumed (Lifecycle Event)
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:44:34 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Instance spawned successfully.
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:44:34 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308674.478651, 7c1f5584-1f4a-4c09-80ba-774d013ea1bd => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:44:34 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] VM Started (Lifecycle Event)
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:44:34 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:44:34 user nova-compute[72818]: INFO nova.compute.manager [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-71e3d7a4-e362-456f-916c-eaf132d17198 req-8d9406d3-0e11-4c91-adc7-b51a29d0a54e service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Received event network-vif-plugged-326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-71e3d7a4-e362-456f-916c-eaf132d17198 req-8d9406d3-0e11-4c91-adc7-b51a29d0a54e service nova] Acquiring lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-71e3d7a4-e362-456f-916c-eaf132d17198 req-8d9406d3-0e11-4c91-adc7-b51a29d0a54e service nova] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-71e3d7a4-e362-456f-916c-eaf132d17198 req-8d9406d3-0e11-4c91-adc7-b51a29d0a54e service nova] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-71e3d7a4-e362-456f-916c-eaf132d17198 req-8d9406d3-0e11-4c91-adc7-b51a29d0a54e service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] No waiting events found dispatching network-vif-plugged-326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:44:34 user nova-compute[72818]: WARNING nova.compute.manager [req-71e3d7a4-e362-456f-916c-eaf132d17198 req-8d9406d3-0e11-4c91-adc7-b51a29d0a54e service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Received unexpected event network-vif-plugged-326cae3e-69af-488f-9451-59f04fff1402 for instance with vm_state building and task_state spawning.
Aug 17 21:44:34 user nova-compute[72818]: INFO nova.compute.manager [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Took 6.69 seconds to build instance.
Aug 17 21:44:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-014a3d59-8109-4b9c-9a6d-34dc27c43f61 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.791s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG nova.objects.instance [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'flavor' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:44 user nova-compute[72818]: INFO nova.compute.manager [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attaching volume 2d91b119-1204-4940-82d2-51d637cc5fe4 to /dev/vdb
Aug 17 21:44:44 user nova-compute[72818]: DEBUG os_brick.utils [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf3da8f-b2c8-4a0b-a8e3-197de07ff8a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4e0002-152e-4307-b4ab-b3573afa6264]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb15c83e-2214-46b6-82e2-a828c52c04be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[54eef063-378f-4627-a7fa-ed5a4bdb1e97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:44:44 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:44:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a46a3db-13fa-4ec0-8e42-8b8a8f96c7de]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG os_brick.utils [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:44:44 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updating existing volume attachment record: d0b1405d-e2f9-4ecd-8916-782092b13031 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:44:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-e0ded734-d4ce-4566-acd0-5dba3346e4f3 req-f929fb68-bc56-42b8-9674-dee9f9763ccf service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-changed-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:48 user nova-compute[72818]: DEBUG nova.compute.manager [req-e0ded734-d4ce-4566-acd0-5dba3346e4f3 req-f929fb68-bc56-42b8-9674-dee9f9763ccf service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Refreshing instance network info cache due to event network-changed-b9826839-7693-451b-9051-a4a87db6e9ac. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:44:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e0ded734-d4ce-4566-acd0-5dba3346e4f3 req-f929fb68-bc56-42b8-9674-dee9f9763ccf service nova] Acquiring lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:44:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e0ded734-d4ce-4566-acd0-5dba3346e4f3 req-f929fb68-bc56-42b8-9674-dee9f9763ccf service nova] Acquired lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:44:48 user nova-compute[72818]: DEBUG nova.network.neutron [req-e0ded734-d4ce-4566-acd0-5dba3346e4f3 req-f929fb68-bc56-42b8-9674-dee9f9763ccf service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Refreshing network info cache for port b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:44:48 user nova-compute[72818]: DEBUG nova.network.neutron [req-e0ded734-d4ce-4566-acd0-5dba3346e4f3 req-f929fb68-bc56-42b8-9674-dee9f9763ccf service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updated VIF entry in instance network info cache for port b9826839-7693-451b-9051-a4a87db6e9ac. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:44:48 user nova-compute[72818]: DEBUG nova.network.neutron [req-e0ded734-d4ce-4566-acd0-5dba3346e4f3 req-f929fb68-bc56-42b8-9674-dee9f9763ccf service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updating instance_info_cache with network_info: [{"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:44:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e0ded734-d4ce-4566-acd0-5dba3346e4f3 req-f929fb68-bc56-42b8-9674-dee9f9763ccf service nova] Releasing lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:44:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "2551d322-916b-4b81-9e50-7c174108b741" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:53 user nova-compute[72818]: INFO nova.compute.manager [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Shelving
Aug 17 21:44:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:53 user nova-compute[72818]: DEBUG nova.compute.manager [req-f22f4de3-0f6b-4a71-89a3-58665404414c req-4473ce39-68e6-43c2-8abd-d83481e55d6b service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-vif-unplugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f22f4de3-0f6b-4a71-89a3-58665404414c req-4473ce39-68e6-43c2-8abd-d83481e55d6b service nova] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f22f4de3-0f6b-4a71-89a3-58665404414c req-4473ce39-68e6-43c2-8abd-d83481e55d6b service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f22f4de3-0f6b-4a71-89a3-58665404414c req-4473ce39-68e6-43c2-8abd-d83481e55d6b service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:53 user nova-compute[72818]: DEBUG nova.compute.manager [req-f22f4de3-0f6b-4a71-89a3-58665404414c req-4473ce39-68e6-43c2-8abd-d83481e55d6b service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] No waiting events found dispatching network-vif-unplugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:44:53 user nova-compute[72818]: WARNING nova.compute.manager [req-f22f4de3-0f6b-4a71-89a3-58665404414c req-4473ce39-68e6-43c2-8abd-d83481e55d6b service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received unexpected event network-vif-unplugged-b9826839-7693-451b-9051-a4a87db6e9ac for instance with vm_state active and task_state shelving.
Aug 17 21:44:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:54 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Instance destroyed successfully.
Aug 17 21:44:54 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Beginning cold snapshot process
Aug 17 21:44:54 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:44:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk /opt/stack/data/nova/instances/snapshots/tmprc0hxf00/83a2ebb2a3fc43ba80a8c3d6dbf08641 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk /opt/stack/data/nova/instances/snapshots/tmprc0hxf00/83a2ebb2a3fc43ba80a8c3d6dbf08641" returned: 0 in 0.530s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:54 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Snapshot extracted, beginning image upload
Aug 17 21:44:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-1d98a4a5-759b-40e2-965f-1ae884df3494 req-5190acb9-4c84-4589-958f-ac34a6b09c32 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1d98a4a5-759b-40e2-965f-1ae884df3494 req-5190acb9-4c84-4589-958f-ac34a6b09c32 service nova] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1d98a4a5-759b-40e2-965f-1ae884df3494 req-5190acb9-4c84-4589-958f-ac34a6b09c32 service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1d98a4a5-759b-40e2-965f-1ae884df3494 req-5190acb9-4c84-4589-958f-ac34a6b09c32 service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-1d98a4a5-759b-40e2-965f-1ae884df3494 req-5190acb9-4c84-4589-958f-ac34a6b09c32 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] No waiting events found dispatching network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:44:55 user nova-compute[72818]: WARNING nova.compute.manager [req-1d98a4a5-759b-40e2-965f-1ae884df3494 req-5190acb9-4c84-4589-958f-ac34a6b09c32 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received unexpected event network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 21:44:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bvKrBpOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:44:55 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:44:55 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:44:55 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1031c1fc-beac-4a8c-8467-77b59702d6ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:44:55 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1348e85c-b18b-4abf-8109-13d9a414d438]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4] added
Aug 17 21:44:55 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcddb8a-a033-4357-93fb-56756630ddfb]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd0773b-3fc4-4021-b277-69116c899f45]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bvKrBpOq {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bvKrBpOq" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[70be6ce4-5753-45ca-9ffe-50d2939c364a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bvKrBpOq'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[500c6a79-53bd-426a-b917-e81d08e2e1c9]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[563bb0fb-d1d2-4d74-bf4e-95f81757a34b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:44:55 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:44:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:44:55 user nova-compute[72818]:  {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:44:55 user nova-compute[72818]: WARNING os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 21:44:55 user nova-compute[72818]: 
Aug 17 21:44:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49776ef-660f-4317-bf70-97436d82a7e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4, portal: 172.16.0.220,3260]
Aug 17 21:44:56 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4, portal: 172.16.0.220,3260] successful.
Aug 17 21:44:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a60ff0f-2716-4582-ada8-f0ac825c1e50]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[75610079-540a-4ff1-a593-7e3b6e279f34]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 (non-flash)
Aug 17 21:44:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 (non-flash)
Aug 17 21:44:56 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[97453d3a-23dd-408b-964f-dce2e7b1953f]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:44:56 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bvKrBpOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26338346261343835', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338346261343835', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG nova.objects.instance [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'flavor' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:44:57 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:44:57 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:44:57 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:44:57 user nova-compute[72818]:   <serial>2d91b119-1204-4940-82d2-51d637cc5fe4</serial>
Aug 17 21:44:57 user nova-compute[72818]: </disk>
Aug 17 21:44:57 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:44:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Snapshot image upload complete
Aug 17 21:44:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:44:57 user nova-compute[72818]: INFO nova.compute.manager [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Shelve offloading
Aug 17 21:44:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Instance destroyed successfully.
Aug 17 21:44:57 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquired lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No VIF found with MAC fa:16:3e:60:8b:76, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-783e9059-78a4-4535-8f65-6f5ff9bc3b9c tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.216s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updating instance_info_cache with network_info: [{"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:44:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Releasing lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:44:58 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Instance destroyed successfully.
Aug 17 21:44:58 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'resources' on Instance uuid 2551d322-916b-4b81-9e50-7c174108b741 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1377529842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1377529842',id=46,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDspgLsuK0Yrn4L/u+cPnmrsz3U7bF8hKZw6mIacC7jBzHbCCKbAxi+HKKhjJ0ZuHJrpFY126zMOVHFgOlvJzoSDf2KbmNaV3WHtsZGkeYThqwZyi0L+H4cNNMIKBxAHw==',key_name='tempest-keypair-581168616',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:43:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4a9d9dc56ba84253be502280f64d7b59',ramdisk_id='',reservation_id='r-grwff5oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-895220279',owner_user_name='tempest-AttachVolumeShelveTestJSON-895220279-project-member',shelved_at='2023-08-17T21:44:57.341107',shelved_host='user',shelved_image_id='bf883ffc-971f-44ec-a7bd-6ad98f937ca8'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcc7e79679c4ebb915828988321acc8',uuid=2551d322-916b-4b81-9e50-7c174108b741,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converting VIF {"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG os_vif [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-2de72607-7ebd-4b30-aa55-e731a46ec36d req-0478be4b-cd6e-480f-a035-0980517b6565 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-changed-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-2de72607-7ebd-4b30-aa55-e731a46ec36d req-0478be4b-cd6e-480f-a035-0980517b6565 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Refreshing instance network info cache due to event network-changed-b9826839-7693-451b-9051-a4a87db6e9ac. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2de72607-7ebd-4b30-aa55-e731a46ec36d req-0478be4b-cd6e-480f-a035-0980517b6565 service nova] Acquiring lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2de72607-7ebd-4b30-aa55-e731a46ec36d req-0478be4b-cd6e-480f-a035-0980517b6565 service nova] Acquired lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG nova.network.neutron [req-2de72607-7ebd-4b30-aa55-e731a46ec36d req-0478be4b-cd6e-480f-a035-0980517b6565 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Refreshing network info cache for port b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9826839-76, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:44:58 user nova-compute[72818]: INFO os_vif [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76')
Aug 17 21:44:58 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Deleting instance files /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741_del
Aug 17 21:44:58 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Deletion of /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741_del complete
Aug 17 21:44:58 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Deleted allocations for instance 2551d322-916b-4b81-9e50-7c174108b741
Aug 17 21:44:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:44:58 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'numa_topology' on Instance uuid 2551d322-916b-4b81-9e50-7c174108b741 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:44:59 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:44:59 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:44:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:59 user nova-compute[72818]: DEBUG nova.network.neutron [req-2de72607-7ebd-4b30-aa55-e731a46ec36d req-0478be4b-cd6e-480f-a035-0980517b6565 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updated VIF entry in instance network info cache for port b9826839-7693-451b-9051-a4a87db6e9ac. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:44:59 user nova-compute[72818]: DEBUG nova.network.neutron [req-2de72607-7ebd-4b30-aa55-e731a46ec36d req-0478be4b-cd6e-480f-a035-0980517b6565 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updating instance_info_cache with network_info: [{"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb9826839-76", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:44:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ba773a43-1cf0-4e2c-b8a7-1d1dd9fdb1f1 tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "2551d322-916b-4b81-9e50-7c174108b741" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.984s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:44:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2de72607-7ebd-4b30-aa55-e731a46ec36d req-0478be4b-cd6e-480f-a035-0980517b6565 service nova] Releasing lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:45:00 user nova-compute[72818]: INFO nova.compute.manager [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Detaching volume 2d91b119-1204-4940-82d2-51d637cc5fe4
Aug 17 21:45:00 user nova-compute[72818]: INFO nova.virt.block_device [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attempting to driver detach volume 2d91b119-1204-4940-82d2-51d637cc5fe4 from mountpoint /dev/vdb
Aug 17 21:45:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Attempting to detach device vdb from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:45:00 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:45:00 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:45:00 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:45:00 user nova-compute[72818]:   <serial>2d91b119-1204-4940-82d2-51d637cc5fe4</serial>
Aug 17 21:45:00 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:45:00 user nova-compute[72818]: </disk>
Aug 17 21:45:00 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:45:00 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Successfully detached device vdb from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the persistent domain config.
Aug 17 21:45:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:45:00 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:45:00 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:45:00 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:45:00 user nova-compute[72818]:   <serial>2d91b119-1204-4940-82d2-51d637cc5fe4</serial>
Aug 17 21:45:00 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:45:00 user nova-compute[72818]: </disk>
Aug 17 21:45:00 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308700.7215836, ff7cf0b9-d00e-4595-a279-79d9e7a4801d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:45:00 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Successfully detached device vdb from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the live domain config.
Aug 17 21:45:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bvKrBpOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:45:00 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ae407e-8ebd-4484-8ed4-a8f614ab38d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[38551d26-d10a-4a1b-83ad-065827a434d9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 (non-flash)
Aug 17 21:45:00 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 (non-flash)
Aug 17 21:45:00 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fa83a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[505ace43-ad30-45a6-8189-8020566da647]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f34db8f-0e9c-4c90-9b61-eb1219de7893]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2d0585-5b9c-421a-824e-474525be2478]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e662ee11-601a-4090-9f45-5e317f0c5350]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abe5a1a-b59a-49bd-9ef4-1fa61b5bf0a3]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9976ed-a730-4ec7-aa55-730e5e2504aa]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4, portal: 172.16.0.220,3260]
Aug 17 21:45:00 user nova-compute[72818]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4, portal: 172.16.0.220,3260] successful.
Aug 17 21:45:00 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91b119-1204-4940-82d2-51d637cc5fe4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[11efeaa5-5f65-4acc-bee4-e242a4d1cb40]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] <== disconnect_volume: return (254ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:45:00 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:45:01 user nova-compute[72818]: DEBUG nova.objects.instance [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'flavor' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:45:01 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-57d19af3-11b3-4b26-a01b-a58928136410 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:45:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:07 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:45:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:09 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308694.0780072, 2551d322-916b-4b81-9e50-7c174108b741 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:45:09 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 2551d322-916b-4b81-9e50-7c174108b741] VM Stopped (Lifecycle Event)
Aug 17 21:45:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e4fb1181-9f14-4ec5-ad5b-9c1508c9d6b1 None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:45:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:11 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:45:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:45:15 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:45:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:45:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 21:45:15 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:45:17 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:45:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:18 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:45:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:45:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:45:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:45:18 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:45:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:20 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:45:20 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:45:20 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8364MB free_disk=25.243263244628906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:45:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:45:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:45:20 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:45:20 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:45:20 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 7c1f5584-1f4a-4c09-80ba-774d013ea1bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:45:20 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:45:20 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:45:20 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:45:20 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:45:20 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:45:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:45:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:24 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:45:24 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:45:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:45:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:45:30 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:45:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:45:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-bbf3e79e-3dc8-4856-bbf0-a474955c7dfc req-b489618c-609e-4278-98a3-171cf9203627 service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Received event network-changed-79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:45:42 user nova-compute[72818]: DEBUG nova.compute.manager [req-bbf3e79e-3dc8-4856-bbf0-a474955c7dfc req-b489618c-609e-4278-98a3-171cf9203627 service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Refreshing instance network info cache due to event network-changed-79fb84b1-9e06-4002-8b96-3f966a12639f. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:45:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bbf3e79e-3dc8-4856-bbf0-a474955c7dfc req-b489618c-609e-4278-98a3-171cf9203627 service nova] Acquiring lock "refresh_cache-d60e8d2b-3882-4c46-99cf-4fad2acf6897" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:45:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bbf3e79e-3dc8-4856-bbf0-a474955c7dfc req-b489618c-609e-4278-98a3-171cf9203627 service nova] Acquired lock "refresh_cache-d60e8d2b-3882-4c46-99cf-4fad2acf6897" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:45:42 user nova-compute[72818]: DEBUG nova.network.neutron [req-bbf3e79e-3dc8-4856-bbf0-a474955c7dfc req-b489618c-609e-4278-98a3-171cf9203627 service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Refreshing network info cache for port 79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:45:43 user nova-compute[72818]: DEBUG nova.network.neutron [req-bbf3e79e-3dc8-4856-bbf0-a474955c7dfc req-b489618c-609e-4278-98a3-171cf9203627 service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Updated VIF entry in instance network info cache for port 79fb84b1-9e06-4002-8b96-3f966a12639f. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:45:43 user nova-compute[72818]: DEBUG nova.network.neutron [req-bbf3e79e-3dc8-4856-bbf0-a474955c7dfc req-b489618c-609e-4278-98a3-171cf9203627 service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Updating instance_info_cache with network_info: [{"id": "79fb84b1-9e06-4002-8b96-3f966a12639f", "address": "fa:16:3e:17:04:1c", "network": {"id": "96bcd9a6-7e50-4116-83d4-462035198c52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-203350382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871c508928564101ad0a1dab7a890f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fb84b1-9e", "ovs_interfaceid": "79fb84b1-9e06-4002-8b96-3f966a12639f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:45:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-bbf3e79e-3dc8-4856-bbf0-a474955c7dfc req-b489618c-609e-4278-98a3-171cf9203627 service nova] Releasing lock "refresh_cache-d60e8d2b-3882-4c46-99cf-4fad2acf6897" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:45:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG nova.objects.instance [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lazy-loading 'flavor' on Instance uuid d60e8d2b-3882-4c46-99cf-4fad2acf6897 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:45:44 user nova-compute[72818]: INFO nova.compute.manager [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Attaching volume 83d59c9e-e4a3-4674-9777-018aa5964fc8 to /dev/vdb
Aug 17 21:45:44 user nova-compute[72818]: DEBUG os_brick.utils [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e274569-a0db-4cc8-b5c9-3b595d853c16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2aeae1-d13f-4950-953f-9398335bb23d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdcb25e-8e70-40da-8b43-1b5fe9a84b4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f1c1c-0cc5-4e22-a72f-d7f995cb448c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:45:44 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:45:44 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf5eeac-c76c-47c7-b9ae-b3ae57bacfe3]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG os_brick.utils [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:45:44 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Updating existing volume attachment record: a6e2a62c-e2e5-4a21-bbfb-ba5c8efe592b {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:45:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgcLrKEo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:45:54 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:45:54 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:45:54 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:45:54 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'flavor' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[04be5c63-5a4b-4ff7-8327-6e1da75f2c1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:45:54 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dd7b16-4184-4b79-9c49-9237de93d71e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8] added
Aug 17 21:45:54 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e799de-f804-4132-a4d7-675b7d726946]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaafeef-aaa0-49fa-a8df-b5099ccd279c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgcLrKEo {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgcLrKEo" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[572824b8-40da-4742-b558-82d327ac96cf]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bgcLrKEo'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1eec45-ef70-48a2-be15-248c25078e2d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6113e010-a7c3-422b-836e-ff9f94d262a7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:45:54 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:45:54 user nova-compute[72818]:  {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:45:54 user nova-compute[72818]: WARNING os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 21:45:54 user nova-compute[72818]: 
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:45:54 user nova-compute[72818]: INFO nova.compute.manager [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attaching volume 8b2fd052-7cf9-4f80-8473-b35ae7fe273e to /dev/vdb
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[840b3375-8c4b-44f2-9d81-89e9907bf280]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8, portal: 172.16.0.220,3260]
Aug 17 21:45:54 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8, portal: 172.16.0.220,3260] successful.
Aug 17 21:45:54 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b33e37a-8312-4ffe-8521-a477baf475c0]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.utils [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[70996e49-e603-4013-820d-73ff12fc14f7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:45:54 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:45:54 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db20348-c0ec-46b2-be62-004cb0099619]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[166762cb-8c8f-40b2-9a93-dc291c31faef]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgcLrKEo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a5de3d-7fdb-4972-9f56-8abe39292547]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b17cef-7e66-48fb-8876-36d99c2e4b0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3cfc16-8242-4f53-92dc-28115d6825b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:54 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:45:55 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:45:55 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c72df01-5178-42d8-9b38-b4f4283cc8b3]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG os_brick.utils [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updating existing volume attachment record: d212cb6f-8366-4bd8-b67a-02eaa4ae126e {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23039623837323432', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039623837323432', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG nova.objects.instance [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lazy-loading 'flavor' on Instance uuid d60e8d2b-3882-4c46-99cf-4fad2acf6897 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:45:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:45:55 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:45:55 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:45:55 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:45:55 user nova-compute[72818]:   <serial>83d59c9e-e4a3-4674-9777-018aa5964fc8</serial>
Aug 17 21:45:55 user nova-compute[72818]: </disk>
Aug 17 21:45:55 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:45:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:45:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:45:56 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] No VIF found with MAC fa:16:3e:17:04:1c, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:45:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-997e3411-5901-4cba-9cc1-e304f96ef372 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.170s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:45:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lazy-loading 'flavor' on Instance uuid d60e8d2b-3882-4c46-99cf-4fad2acf6897 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:45:59 user nova-compute[72818]: INFO nova.compute.manager [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Attaching volume f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b to /dev/vdc
Aug 17 21:45:59 user nova-compute[72818]: DEBUG os_brick.utils [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6adc817-5d9b-4989-b1ea-891f2c5e7918]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94cfb61-3d41-4a91-ad66-785e5365c412]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec3463e-4080-4a6d-8a69-8b3b010923c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cf4b43-c2ff-4267-b377-e3171c433712]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:45:59 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:46:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:46:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:00 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:46:00 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:46:00 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[831fe637-cce1-4e8d-9d50-65c798a45f15]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:46:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:46:00 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:46:00 user nova-compute[72818]: DEBUG os_brick.utils [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:46:00 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Updating existing volume attachment record: daa8c775-7400-4094-87a0-cf95801cce1d {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:46:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmocsCXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:46:05 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:46:05 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:46:05 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dde77ff-9aab-48d6-b653-bd70827eda90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:46:05 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[45788aee-2c2c-41ad-99e6-11de744d22ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e] added
Aug 17 21:46:05 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e521bb76-be12-4889-a860-f11640b1d772]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6a81b3-7949-428d-9f80-f583a0261309]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmocsCXB {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmocsCXB" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dbc95f-4ff5-491a-8c84-42d7915dc18f]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NmocsCXB'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f95003f-ea24-4cd5-8a08-397e7480cb91]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c523de2-77dd-4ff6-b47f-e1e19b447bf1]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:05 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:05 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[81751f3e-2d91-47bf-9985-b89ff484332b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e, portal: 172.16.0.220,3260]
Aug 17 21:46:05 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e, portal: 172.16.0.220,3260] successful.
Aug 17 21:46:05 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecd9f53-dc8b-4a02-b940-7b8b32056ea1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96ada01-473c-43e5-96b5-4c1362660584]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:05 user nova-compute[72818]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e (non-flash)
Aug 17 21:46:05 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:05 user nova-compute[72818]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e (non-flash)
Aug 17 21:46:05 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[751de5d8-fc78-4adb-ae6e-5a1b100e5308]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:05 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:46:06 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:46:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmocsCXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:46:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:46:06 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26665666139646364', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:46:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665666139646364', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:46:06 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'flavor' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:06 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:46:06 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:46:06 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:46:06 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:46:06 user nova-compute[72818]:   <serial>8b2fd052-7cf9-4f80-8473-b35ae7fe273e</serial>
Aug 17 21:46:06 user nova-compute[72818]: </disk>
Aug 17 21:46:06 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:46:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:46:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:46:07 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No VIF found with MAC fa:16:3e:60:8b:76, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:46:07 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ea6b79e4-da4c-420d-9e28-14cd5e7644b8 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.695s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:08 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:46:08 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:09 user nova-compute[72818]: INFO nova.compute.manager [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Detaching volume 8b2fd052-7cf9-4f80-8473-b35ae7fe273e
Aug 17 21:46:09 user nova-compute[72818]: INFO nova.virt.block_device [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attempting to driver detach volume 8b2fd052-7cf9-4f80-8473-b35ae7fe273e from mountpoint /dev/vdb
Aug 17 21:46:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Attempting to detach device vdb from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:46:09 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:46:09 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:46:09 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:46:09 user nova-compute[72818]:   <serial>8b2fd052-7cf9-4f80-8473-b35ae7fe273e</serial>
Aug 17 21:46:09 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:46:09 user nova-compute[72818]: </disk>
Aug 17 21:46:09 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:46:09 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Successfully detached device vdb from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the persistent domain config.
Aug 17 21:46:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:46:09 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:46:09 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:46:09 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:46:09 user nova-compute[72818]:   <serial>8b2fd052-7cf9-4f80-8473-b35ae7fe273e</serial>
Aug 17 21:46:09 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:46:09 user nova-compute[72818]: </disk>
Aug 17 21:46:09 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308769.7856135, ff7cf0b9-d00e-4595-a279-79d9e7a4801d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:46:09 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Successfully detached device vdb from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the live domain config.
Aug 17 21:46:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmocsCXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:46:09 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[752b31c1-5ccd-48a1-aa7d-91f309af6066]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebd8a1d-c914-4321-bf1d-459ae7442504]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:09 user nova-compute[72818]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e (non-flash)
Aug 17 21:46:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:09 user nova-compute[72818]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e (non-flash)
Aug 17 21:46:09 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04da2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e'): ({'sdc'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Removing single pathed devices sdc {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f587565f-c4af-435d-beca-62d6e395a261]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b08b3d-fac7-4d61-ab36-2aa8e1edbe74]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Flushing IO for device /dev/sdc {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[062fc64e-a353-4c69-a7a8-9d68cdc7fdb6]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc7bb22-0151-4f02-a899-6345044fc247]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8d44bd-7ccd-405e-99f1-cd1d204b15e2]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[992aef20-7a81-4f1e-8faf-5b2c9fe67b71]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e, portal: 172.16.0.220,3260]
Aug 17 21:46:10 user nova-compute[72818]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e, portal: 172.16.0.220,3260] successful.
Aug 17 21:46:10 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2fd052-7cf9-4f80-8473-b35ae7fe273e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d381c0ff-fd9a-4bce-8816-661e0e088a3c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] <== disconnect_volume: return (274ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmnFDlVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:46:10 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:46:10 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:46:10 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:46:10 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'flavor' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7e48aa-00b0-4695-b44a-7ffcd6df2ac7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:46:10 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d67d790a-5e3a-462f-8054-0ecfe092d190 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.621s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2851ba54-4b35-4570-925c-41fd5e875007]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b] added
Aug 17 21:46:10 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca1848d-e81b-4d96-99f1-41bb076797e6]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b26d0e-5c5a-4b10-b104-d198cadd56a4]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmnFDlVI {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmnFDlVI" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22b8ab3-a36d-457a-97ca-a81bc121bf00]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GmnFDlVI'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f986929f-8438-497f-a5e4-85c80bb0ba70]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:10 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb77e98d-5962-45d1-ab38-a77e1dd5cbfc]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bf43bf-7b20-47d8-8853-b64882233ad8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b, portal: 172.16.0.220,3260]
Aug 17 21:46:11 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b, portal: 172.16.0.220,3260] successful.
Aug 17 21:46:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efbefd5-a3ee-4882-ad67-99e05c004f88]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e673ad-df45-42ee-ba59-626dce100c43]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:11 user nova-compute[72818]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b (non-flash)
Aug 17 21:46:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:11 user nova-compute[72818]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b (non-flash)
Aug 17 21:46:11 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dd9480-1f55-4d78-8e66-77ad52248fdb]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmnFDlVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:46:11 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:46:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:46:12 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26262366336663739', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:46:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262366336663739', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:46:12 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lazy-loading 'flavor' on Instance uuid d60e8d2b-3882-4c46-99cf-4fad2acf6897 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:46:12 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:46:12 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:46:12 user nova-compute[72818]:   <target dev="vdc" bus="virtio"/>
Aug 17 21:46:12 user nova-compute[72818]:   <serial>f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b</serial>
Aug 17 21:46:12 user nova-compute[72818]: </disk>
Aug 17 21:46:12 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:46:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:46:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:46:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:46:12 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] No VIF found with MAC fa:16:3e:17:04:1c, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:46:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b9c712f9-f201-478e-ba5d-6e17da2944d6 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.855s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:46:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:14 user nova-compute[72818]: INFO nova.compute.manager [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Detaching volume f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b
Aug 17 21:46:14 user nova-compute[72818]: INFO nova.virt.block_device [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Attempting to driver detach volume f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b from mountpoint /dev/vdc
Aug 17 21:46:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Attempting to detach device vdc from instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:46:14 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:46:14 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:46:14 user nova-compute[72818]:   <target dev="vdc" bus="virtio"/>
Aug 17 21:46:14 user nova-compute[72818]:   <serial>f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b</serial>
Aug 17 21:46:14 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 21:46:14 user nova-compute[72818]: </disk>
Aug 17 21:46:14 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:46:14 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Successfully detached device vdc from instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 from the persistent domain config.
Aug 17 21:46:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:46:14 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:46:14 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:46:14 user nova-compute[72818]:   <target dev="vdc" bus="virtio"/>
Aug 17 21:46:14 user nova-compute[72818]:   <serial>f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b</serial>
Aug 17 21:46:14 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 21:46:14 user nova-compute[72818]: </disk>
Aug 17 21:46:14 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308774.5620751, d60e8d2b-3882-4c46-99cf-4fad2acf6897 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:46:14 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Successfully detached device vdc from instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 from the live domain config.
Aug 17 21:46:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmnFDlVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:46:14 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12371ee-2383-4fff-87f2-f0f6d178f43f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0650ba49-cf9c-4705-9249-94134a89f880]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:14 user nova-compute[72818]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b (non-flash)
Aug 17 21:46:14 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:14 user nova-compute[72818]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b (non-flash)
Aug 17 21:46:14 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f2855e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b'): ({'sdc'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Removing single pathed devices sdc {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[450485d7-429c-4f24-b496-899d7e37f7a3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[80026dea-a75d-4cdb-b8cc-9c0728b61904]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Flushing IO for device /dev/sdc {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca3c26e-2d05-4015-992a-2dda8b5ab279]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[60252a29-49a9-45ec-bf9f-01adb9e90c48]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e408d9f1-16d0-4546-99a6-c50082fced82]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[993c1476-0553-4641-a9aa-ac7080a751d9]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b, portal: 172.16.0.220,3260]
Aug 17 21:46:14 user nova-compute[72818]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b, portal: 172.16.0.220,3260] successful.
Aug 17 21:46:14 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5fb3a1b-ba2e-4daa-bb41-bc6ed354266b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01fe76d-28e7-43bc-acb4-fd042355a460]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] <== disconnect_volume: return (270ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:46:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:46:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lazy-loading 'flavor' on Instance uuid d60e8d2b-3882-4c46-99cf-4fad2acf6897 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-da912868-c117-40ab-97d7-a31647dececb tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.600s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:15 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:46:16 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:46:16 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72818) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 21:46:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:17 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:46:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:46:17 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:46:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:46:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:46:18 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:46:18 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:18 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updating instance_info_cache with network_info: [{"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-ff7cf0b9-d00e-4595-a279-79d9e7a4801d" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-b994b3b9-39b5-4269-b695-f507214127de req-4dfa54c0-31be-4c3a-a25e-6f282dad2def service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Received event network-changed-326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG nova.compute.manager [req-b994b3b9-39b5-4269-b695-f507214127de req-4dfa54c0-31be-4c3a-a25e-6f282dad2def service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Refreshing instance network info cache due to event network-changed-326cae3e-69af-488f-9451-59f04fff1402. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b994b3b9-39b5-4269-b695-f507214127de req-4dfa54c0-31be-4c3a-a25e-6f282dad2def service nova] Acquiring lock "refresh_cache-7c1f5584-1f4a-4c09-80ba-774d013ea1bd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b994b3b9-39b5-4269-b695-f507214127de req-4dfa54c0-31be-4c3a-a25e-6f282dad2def service nova] Acquired lock "refresh_cache-7c1f5584-1f4a-4c09-80ba-774d013ea1bd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG nova.network.neutron [req-b994b3b9-39b5-4269-b695-f507214127de req-4dfa54c0-31be-4c3a-a25e-6f282dad2def service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Refreshing network info cache for port 326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG nova.network.neutron [req-b994b3b9-39b5-4269-b695-f507214127de req-4dfa54c0-31be-4c3a-a25e-6f282dad2def service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Updated VIF entry in instance network info cache for port 326cae3e-69af-488f-9451-59f04fff1402. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG nova.network.neutron [req-b994b3b9-39b5-4269-b695-f507214127de req-4dfa54c0-31be-4c3a-a25e-6f282dad2def service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Updating instance_info_cache with network_info: [{"id": "326cae3e-69af-488f-9451-59f04fff1402", "address": "fa:16:3e:76:53:eb", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326cae3e-69", "ovs_interfaceid": "326cae3e-69af-488f-9451-59f04fff1402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b994b3b9-39b5-4269-b695-f507214127de req-4dfa54c0-31be-4c3a-a25e-6f282dad2def service nova] Releasing lock "refresh_cache-7c1f5584-1f4a-4c09-80ba-774d013ea1bd" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:46:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:20 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:46:20 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:46:20 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8441MB free_disk=25.24083709716797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:46:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 7c1f5584-1f4a-4c09-80ba-774d013ea1bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing inventories for resource provider d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating ProviderTree inventory for provider d156e3af-684d-47e1-a951-585f9c95fa46 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing aggregate associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, aggregates: None {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing trait associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:46:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:23 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'flavor' on Instance uuid 7c1f5584-1f4a-4c09-80ba-774d013ea1bd {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:24 user nova-compute[72818]: INFO nova.compute.manager [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Attaching volume d5443fba-d054-4cff-a1c5-c759a53579a5 to /dev/vdb
Aug 17 21:46:24 user nova-compute[72818]: DEBUG os_brick.utils [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6a8fbd-fadd-4faf-a274-118708d0765e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c2bae0-65fb-4637-8fa8-5493f194e906]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5695f47d-e041-4268-a095-0bf6646cfa12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8f4186-f640-43ac-878c-b7e572e40d29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:46:24 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:46:24 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[69351bcb-7f58-4a51-8749-c2f3c9dcb849]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG os_brick.utils [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:46:24 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Updating existing volume attachment record: 0c62857e-a29b-408c-9037-7eaf602fb52c {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:46:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:46:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:46:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:46:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:46:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 21:46:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] There are 0 instances to clean {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 21:46:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:46:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGPfjBRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:46:34 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:46:34 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:46:34 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c849ded0-42b2-49b5-ab28-40079f488837]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:46:34 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44ee8b5-626f-4f52-aefc-f51ecf8f2a1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5] added
Aug 17 21:46:34 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f621184-5da6-43a7-949b-e3a3cbbf2b94]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6260620d-792a-4029-abd8-2c7a4cfc641d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGPfjBRJ {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGPfjBRJ" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2ea22b-deda-46c3-b37b-440374d97c19]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NGPfjBRJ'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1fa94e-ffd6-476e-a7d0-2dedbbbbe000]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1847d8f-3446-4647-a1ca-6ececcfde214]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:34 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:34 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[51612696-b07e-474b-82fc-2f0b0ccf723a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5, portal: 172.16.0.220,3260]
Aug 17 21:46:34 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5, portal: 172.16.0.220,3260] successful.
Aug 17 21:46:34 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[422f6b67-254d-4ff3-b1b5-adf57e100c6e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f29dd7f-a6e3-4bb8-88b3-b137f790d7e2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:34 user nova-compute[72818]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 (non-flash)
Aug 17 21:46:34 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:34 user nova-compute[72818]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 (non-flash)
Aug 17 21:46:34 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4d77f5-1e4d-4ed5-ae73-21e89c43f683]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:46:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGPfjBRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:46:35 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:46:35 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26662633532383230', 'path': '/dev/sdc'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:46:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662633532383230', 'path': '/dev/sdc'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:46:35 user nova-compute[72818]: DEBUG nova.objects.instance [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'flavor' on Instance uuid 7c1f5584-1f4a-4c09-80ba-774d013ea1bd {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:35 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:46:35 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:46:35 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:46:35 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:46:35 user nova-compute[72818]:   <serial>d5443fba-d054-4cff-a1c5-c759a53579a5</serial>
Aug 17 21:46:35 user nova-compute[72818]: </disk>
Aug 17 21:46:35 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:46:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:46:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:46:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No VIF found with MAC fa:16:3e:76:53:eb, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:46:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-d5c2a967-2433-4fe9-9083-7472236b1147 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.287s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:37 user nova-compute[72818]: INFO nova.compute.manager [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Detaching volume d5443fba-d054-4cff-a1c5-c759a53579a5
Aug 17 21:46:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:37 user nova-compute[72818]: INFO nova.virt.block_device [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Attempting to driver detach volume d5443fba-d054-4cff-a1c5-c759a53579a5 from mountpoint /dev/vdb
Aug 17 21:46:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Attempting to detach device vdb from instance 7c1f5584-1f4a-4c09-80ba-774d013ea1bd from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:46:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:46:37 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:46:37 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:46:37 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:46:37 user nova-compute[72818]:   <serial>d5443fba-d054-4cff-a1c5-c759a53579a5</serial>
Aug 17 21:46:37 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:46:37 user nova-compute[72818]: </disk>
Aug 17 21:46:37 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:46:37 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully detached device vdb from instance 7c1f5584-1f4a-4c09-80ba-774d013ea1bd from the persistent domain config.
Aug 17 21:46:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7c1f5584-1f4a-4c09-80ba-774d013ea1bd from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:46:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:46:37 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:46:37 user nova-compute[72818]:   <source dev="/dev/sdc"/>
Aug 17 21:46:37 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:46:37 user nova-compute[72818]:   <serial>d5443fba-d054-4cff-a1c5-c759a53579a5</serial>
Aug 17 21:46:37 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:46:37 user nova-compute[72818]: </disk>
Aug 17 21:46:37 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308798.0167198, 7c1f5584-1f4a-4c09-80ba-774d013ea1bd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7c1f5584-1f4a-4c09-80ba-774d013ea1bd {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:46:38 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully detached device vdb from instance 7c1f5584-1f4a-4c09-80ba-774d013ea1bd from the live domain config.
Aug 17 21:46:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGPfjBRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:46:38 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8713be3e-4c45-4a93-9c28-bef9a8435c3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb93dc31-74c5-4434-88ba-b98cddd81900]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:38 user nova-compute[72818]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 (non-flash)
Aug 17 21:46:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:46:38 user nova-compute[72818]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 (non-flash)
Aug 17 21:46:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04c1f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5'): ({'sdc'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Removing single pathed devices sdc {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a7eede-3462-4f7f-8802-a17b5dbc53cf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[345cf35a-dbba-4d66-aa61-d8b31dcfcfea]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Flushing IO for device /dev/sdc {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b861ea-87e7-4a6a-b64a-1158e3aa0dd9]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bd9fdb-dacb-48c8-92b3-c1058c8e5d18]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] SCSI volumes sdc have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aff3296-bb21-407c-948f-c5590748dc3d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc86d47-a865-4bbe-b93b-c34ee2a1f15c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5, portal: 172.16.0.220,3260]
Aug 17 21:46:38 user nova-compute[72818]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5, portal: 172.16.0.220,3260] successful.
Aug 17 21:46:38 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5443fba-d054-4cff-a1c5-c759a53579a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fc615a-d369-4eb9-b491-c28edefe36f3]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] <== disconnect_volume: return (265ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:46:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:39 user nova-compute[72818]: DEBUG nova.objects.instance [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'flavor' on Instance uuid 7c1f5584-1f4a-4c09-80ba-774d013ea1bd {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-a8ae97c5-e922-49cb-9f6a-189a0e6230c0 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.595s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "2551d322-916b-4b81-9e50-7c174108b741" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:45 user nova-compute[72818]: INFO nova.compute.manager [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Unshelving
Aug 17 21:46:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:45 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'pci_requests' on Instance uuid 2551d322-916b-4b81-9e50-7c174108b741 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:45 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'numa_topology' on Instance uuid 2551d322-916b-4b81-9e50-7c174108b741 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:45 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:46:45 user nova-compute[72818]: INFO nova.compute.claims [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Claim successful on node user
Aug 17 21:46:45 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:46:45 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:46:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:46 user nova-compute[72818]: INFO nova.network.neutron [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updating port b9826839-7693-451b-9051-a4a87db6e9ac with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 21:46:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:46:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquired lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:46:46 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:46:46 user nova-compute[72818]: DEBUG nova.compute.manager [req-c614bff7-e9d3-4060-8c75-80e7dd31009a req-6d53cc8c-9934-4cd5-bb8d-eebec4b49cd7 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-changed-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:46:46 user nova-compute[72818]: DEBUG nova.compute.manager [req-c614bff7-e9d3-4060-8c75-80e7dd31009a req-6d53cc8c-9934-4cd5-bb8d-eebec4b49cd7 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Refreshing instance network info cache due to event network-changed-b9826839-7693-451b-9051-a4a87db6e9ac. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:46:46 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c614bff7-e9d3-4060-8c75-80e7dd31009a req-6d53cc8c-9934-4cd5-bb8d-eebec4b49cd7 service nova] Acquiring lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:46:47 user nova-compute[72818]: DEBUG nova.network.neutron [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updating instance_info_cache with network_info: [{"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:46:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Releasing lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:46:47 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:46:47 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Creating image(s)
Aug 17 21:46:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "/opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "/opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "/opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:47 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2551d322-916b-4b81-9e50-7c174108b741 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c614bff7-e9d3-4060-8c75-80e7dd31009a req-6d53cc8c-9934-4cd5-bb8d-eebec4b49cd7 service nova] Acquired lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:46:47 user nova-compute[72818]: DEBUG nova.network.neutron [req-c614bff7-e9d3-4060-8c75-80e7dd31009a req-6d53cc8c-9934-4cd5-bb8d-eebec4b49cd7 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Refreshing network info cache for port b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:46:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "4226b1acd3b1690228c220f7a06e0c065a3a4fdb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "4226b1acd3b1690228c220f7a06e0c065a3a4fdb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb.part --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb.part --force-share --output=json" returned: 0 in 0.190s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG nova.virt.images [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] bf883ffc-971f-44ec-a7bd-6ad98f937ca8 was qcow2, converting to raw {{(pid=72818) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb.part /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb.converted {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG nova.network.neutron [req-c614bff7-e9d3-4060-8c75-80e7dd31009a req-6d53cc8c-9934-4cd5-bb8d-eebec4b49cd7 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updated VIF entry in instance network info cache for port b9826839-7693-451b-9051-a4a87db6e9ac. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG nova.network.neutron [req-c614bff7-e9d3-4060-8c75-80e7dd31009a req-6d53cc8c-9934-4cd5-bb8d-eebec4b49cd7 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updating instance_info_cache with network_info: [{"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-c614bff7-e9d3-4060-8c75-80e7dd31009a req-6d53cc8c-9934-4cd5-bb8d-eebec4b49cd7 service nova] Releasing lock "refresh_cache-2551d322-916b-4b81-9e50-7c174108b741" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb.part /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb.converted" returned: 0 in 0.255s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb.converted --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "4226b1acd3b1690228c220f7a06e0c065a3a4fdb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.537s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "4226b1acd3b1690228c220f7a06e0c065a3a4fdb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "4226b1acd3b1690228c220f7a06e0c065a3a4fdb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:48 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb,backing_fmt=raw /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb,backing_fmt=raw /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk 1073741824" returned: 0 in 0.048s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:49 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "4226b1acd3b1690228c220f7a06e0c065a3a4fdb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:49 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'migration_context' on Instance uuid 2551d322-916b-4b81-9e50-7c174108b741 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:49 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Rebasing disk image.
Aug 17 21:46:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:49 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 -F raw /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 -F raw /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk" returned: 0 in 2.390s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Ensure instance console log exists: /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Start _get_guest_xml network_info=[{"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='51f022fae7f88985131a8544b6ac422a',container_format='bare',created_at=2023-08-17T21:44:53Z,direct_url=<?>,disk_format='qcow2',id=bf883ffc-971f-44ec-a7bd-6ad98f937ca8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1377529842-shelved',owner='4a9d9dc56ba84253be502280f64d7b59',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T21:44:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:46:51 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:46:51 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='51f022fae7f88985131a8544b6ac422a',container_format='bare',created_at=2023-08-17T21:44:53Z,direct_url=<?>,disk_format='qcow2',id=bf883ffc-971f-44ec-a7bd-6ad98f937ca8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1377529842-shelved',owner='4a9d9dc56ba84253be502280f64d7b59',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T21:44:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:46:51 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2551d322-916b-4b81-9e50-7c174108b741 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1377529842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1377529842',id=46,image_ref='bf883ffc-971f-44ec-a7bd-6ad98f937ca8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-581168616',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:43:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4a9d9dc56ba84253be502280f64d7b59',ramdisk_id='',reservation_id='r-grwff5oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-895220279',owner_user_name='tempest-AttachVolumeShelveTestJSON-895220279-project-member',shelved_at='2023-08-17T21:44:57.341107',shelved_host='user',shelved_image_id='bf883ffc-971f-44ec-a7bd-6ad98f937ca8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcc7e79679c4ebb915828988321acc8',uuid=2551d322-916b-4b81-9e50-7c174108b741,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converting VIF {"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'pci_devices' on Instance uuid 2551d322-916b-4b81-9e50-7c174108b741 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:46:52 user nova-compute[72818]:   <uuid>2551d322-916b-4b81-9e50-7c174108b741</uuid>
Aug 17 21:46:52 user nova-compute[72818]:   <name>instance-0000002e</name>
Aug 17 21:46:52 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:46:52 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:46:52 user nova-compute[72818]:   <metadata>
Aug 17 21:46:52 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:46:52 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:46:52 user nova-compute[72818]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1377529842</nova:name>
Aug 17 21:46:52 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:46:51</nova:creationTime>
Aug 17 21:46:52 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:46:52 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:46:52 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:46:52 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:46:52 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:46:52 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:46:52 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:46:52 user nova-compute[72818]:       <nova:owner>
Aug 17 21:46:52 user nova-compute[72818]:         <nova:user uuid="fbcc7e79679c4ebb915828988321acc8">tempest-AttachVolumeShelveTestJSON-895220279-project-member</nova:user>
Aug 17 21:46:52 user nova-compute[72818]:         <nova:project uuid="4a9d9dc56ba84253be502280f64d7b59">tempest-AttachVolumeShelveTestJSON-895220279</nova:project>
Aug 17 21:46:52 user nova-compute[72818]:       </nova:owner>
Aug 17 21:46:52 user nova-compute[72818]:       <nova:root type="image" uuid="bf883ffc-971f-44ec-a7bd-6ad98f937ca8"/>
Aug 17 21:46:52 user nova-compute[72818]:       <nova:ports>
Aug 17 21:46:52 user nova-compute[72818]:         <nova:port uuid="b9826839-7693-451b-9051-a4a87db6e9ac">
Aug 17 21:46:52 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 21:46:52 user nova-compute[72818]:         </nova:port>
Aug 17 21:46:52 user nova-compute[72818]:       </nova:ports>
Aug 17 21:46:52 user nova-compute[72818]:     </nova:instance>
Aug 17 21:46:52 user nova-compute[72818]:   </metadata>
Aug 17 21:46:52 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:46:52 user nova-compute[72818]:     <system>
Aug 17 21:46:52 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:46:52 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:46:52 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:46:52 user nova-compute[72818]:       <entry name="serial">2551d322-916b-4b81-9e50-7c174108b741</entry>
Aug 17 21:46:52 user nova-compute[72818]:       <entry name="uuid">2551d322-916b-4b81-9e50-7c174108b741</entry>
Aug 17 21:46:52 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:46:52 user nova-compute[72818]:     </system>
Aug 17 21:46:52 user nova-compute[72818]:   </sysinfo>
Aug 17 21:46:52 user nova-compute[72818]:   <os>
Aug 17 21:46:52 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:46:52 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:46:52 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:46:52 user nova-compute[72818]:   </os>
Aug 17 21:46:52 user nova-compute[72818]:   <features>
Aug 17 21:46:52 user nova-compute[72818]:     <acpi/>
Aug 17 21:46:52 user nova-compute[72818]:     <apic/>
Aug 17 21:46:52 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:46:52 user nova-compute[72818]:   </features>
Aug 17 21:46:52 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:46:52 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:46:52 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:46:52 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:46:52 user nova-compute[72818]:   </clock>
Aug 17 21:46:52 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:46:52 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:46:52 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:46:52 user nova-compute[72818]:   </cpu>
Aug 17 21:46:52 user nova-compute[72818]:   <devices>
Aug 17 21:46:52 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:46:52 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:46:52 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk"/>
Aug 17 21:46:52 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:46:52 user nova-compute[72818]:     </disk>
Aug 17 21:46:52 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:46:52 user nova-compute[72818]:       <mac address="fa:16:3e:4c:85:23"/>
Aug 17 21:46:52 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:46:52 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:46:52 user nova-compute[72818]:       <target dev="tapb9826839-76"/>
Aug 17 21:46:52 user nova-compute[72818]:     </interface>
Aug 17 21:46:52 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:46:52 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/console.log" append="off"/>
Aug 17 21:46:52 user nova-compute[72818]:     </serial>
Aug 17 21:46:52 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:46:52 user nova-compute[72818]:     <video>
Aug 17 21:46:52 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:46:52 user nova-compute[72818]:     </video>
Aug 17 21:46:52 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:46:52 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:46:52 user nova-compute[72818]:     </rng>
Aug 17 21:46:52 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:46:52 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:46:52 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:46:52 user nova-compute[72818]:     </memballoon>
Aug 17 21:46:52 user nova-compute[72818]:   </devices>
Aug 17 21:46:52 user nova-compute[72818]: </domain>
Aug 17 21:46:52 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1377529842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1377529842',id=46,image_ref='bf883ffc-971f-44ec-a7bd-6ad98f937ca8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-581168616',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:43:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4a9d9dc56ba84253be502280f64d7b59',ramdisk_id='',reservation_id='r-grwff5oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-895220279',owner_user_name='tempest-AttachVolumeShelveTestJSON-895220279-project-member',shelved_at='2023-08-17T21:44:57.341107',shelved_host='user',shelved_image_id='bf883ffc-971f-44ec-a7bd-6ad98f937ca8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcc7e79679c4ebb915828988321acc8',uuid=2551d322-916b-4b81-9e50-7c174108b741,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converting VIF {"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG os_vif [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9826839-76, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9826839-76, col_values=(('external_ids', {'iface-id': 'b9826839-7693-451b-9051-a4a87db6e9ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:85:23', 'vm-uuid': '2551d322-916b-4b81-9e50-7c174108b741'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:52 user nova-compute[72818]: INFO os_vif [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76')
Aug 17 21:46:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] No VIF found with MAC fa:16:3e:4c:85:23, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:46:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:53 user nova-compute[72818]: DEBUG nova.compute.manager [req-40df321e-3da4-4bbd-9c41-17df3f8882d0 req-62c51595-b505-49f7-a5c7-2c384674a75e service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:46:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-40df321e-3da4-4bbd-9c41-17df3f8882d0 req-62c51595-b505-49f7-a5c7-2c384674a75e service nova] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-40df321e-3da4-4bbd-9c41-17df3f8882d0 req-62c51595-b505-49f7-a5c7-2c384674a75e service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-40df321e-3da4-4bbd-9c41-17df3f8882d0 req-62c51595-b505-49f7-a5c7-2c384674a75e service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:53 user nova-compute[72818]: DEBUG nova.compute.manager [req-40df321e-3da4-4bbd-9c41-17df3f8882d0 req-62c51595-b505-49f7-a5c7-2c384674a75e service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] No waiting events found dispatching network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:46:53 user nova-compute[72818]: WARNING nova.compute.manager [req-40df321e-3da4-4bbd-9c41-17df3f8882d0 req-62c51595-b505-49f7-a5c7-2c384674a75e service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received unexpected event network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 21:46:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:55 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308815.5600142, 2551d322-916b-4b81-9e50-7c174108b741 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:46:55 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] VM Resumed (Lifecycle Event)
Aug 17 21:46:55 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:46:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:46:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Instance spawned successfully.
Aug 17 21:46:55 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:46:55 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:46:55 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:46:55 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308815.5617805, 2551d322-916b-4b81-9e50-7c174108b741 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:46:55 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] VM Started (Lifecycle Event)
Aug 17 21:46:55 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:46:55 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:46:55 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:46:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-f333e750-a47a-4010-b79b-0ee00aa8d2f5 req-716c2650-bd9e-41ec-83dd-a1abd1509e63 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:46:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f333e750-a47a-4010-b79b-0ee00aa8d2f5 req-716c2650-bd9e-41ec-83dd-a1abd1509e63 service nova] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:46:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f333e750-a47a-4010-b79b-0ee00aa8d2f5 req-716c2650-bd9e-41ec-83dd-a1abd1509e63 service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:46:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-f333e750-a47a-4010-b79b-0ee00aa8d2f5 req-716c2650-bd9e-41ec-83dd-a1abd1509e63 service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-f333e750-a47a-4010-b79b-0ee00aa8d2f5 req-716c2650-bd9e-41ec-83dd-a1abd1509e63 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] No waiting events found dispatching network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:46:55 user nova-compute[72818]: WARNING nova.compute.manager [req-f333e750-a47a-4010-b79b-0ee00aa8d2f5 req-716c2650-bd9e-41ec-83dd-a1abd1509e63 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received unexpected event network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 21:46:55 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:46:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f48f128d-19d9-449c-84ad-272e47a6237b tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "2551d322-916b-4b81-9e50-7c174108b741" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.274s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:46:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:46:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG nova.objects.instance [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'flavor' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:03 user nova-compute[72818]: INFO nova.compute.manager [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attaching volume 23b4f386-23d3-478e-a069-3605fe9abe9a to /dev/vdb
Aug 17 21:47:03 user nova-compute[72818]: DEBUG os_brick.utils [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa694a7b-9e84-4a4d-a421-15b73d8b6ee1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[af198c0f-2ed0-4ce2-a7a9-a6357dc4abbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[adea964e-27ac-4e1e-9e48-bd3ff30ce7a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5236211-4639-4984-a3df-620a6bc7e77e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:47:03 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:47:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[964552ca-4273-4db7-995f-67d697d9614b]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG os_brick.utils [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:47:03 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updating existing volume attachment record: 089180af-0d2e-4dc7-8e51-3e8084ebe55a {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:47:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:04 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:04 user nova-compute[72818]: INFO nova.compute.manager [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Detaching volume 83d59c9e-e4a3-4674-9777-018aa5964fc8
Aug 17 21:47:04 user nova-compute[72818]: INFO nova.virt.block_device [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Attempting to driver detach volume 83d59c9e-e4a3-4674-9777-018aa5964fc8 from mountpoint /dev/vdb
Aug 17 21:47:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Attempting to detach device vdb from instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:47:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:47:04 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:47:04 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:47:04 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:47:04 user nova-compute[72818]:   <serial>83d59c9e-e4a3-4674-9777-018aa5964fc8</serial>
Aug 17 21:47:04 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:47:04 user nova-compute[72818]: </disk>
Aug 17 21:47:04 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:47:04 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Successfully detached device vdb from instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 from the persistent domain config.
Aug 17 21:47:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:47:04 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:47:04 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:47:04 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:47:04 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:47:04 user nova-compute[72818]:   <serial>83d59c9e-e4a3-4674-9777-018aa5964fc8</serial>
Aug 17 21:47:04 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:47:04 user nova-compute[72818]: </disk>
Aug 17 21:47:04 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308825.083857, d60e8d2b-3882-4c46-99cf-4fad2acf6897 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:47:05 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Successfully detached device vdb from instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 from the live domain config.
Aug 17 21:47:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgcLrKEo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:47:05 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27d650e-aac2-404d-b001-2fdbf6a4f95b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b61511-5afd-4a65-83a3-758413d6cfd8]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:47:05 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 (non-flash)
Aug 17 21:47:05 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04fb5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[30099ff2-b8b2-4f4a-a9e6-e9de01850862]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be57c68-8167-4189-9e0f-703a8805b302]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed2b7f-b939-421c-bd7a-c544e35245a8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaa174d-df86-4654-8437-be24cf97080b]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0449e213-15d2-425e-8fd0-2101a9367849]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[171bd638-826f-4547-b59c-d3e449a35745]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8, portal: 172.16.0.220,3260]
Aug 17 21:47:05 user nova-compute[72818]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8, portal: 172.16.0.220,3260] successful.
Aug 17 21:47:05 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d59c9e-e4a3-4674-9777-018aa5964fc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5e2228-422e-4140-a325-525b22fd707e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] <== disconnect_volume: return (277ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:47:05 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:47:06 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lazy-loading 'flavor' on Instance uuid d60e8d2b-3882-4c46-99cf-4fad2acf6897 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:47:06 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec232bb8-bc04-4aca-8380-142a041888e5 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.655s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:47:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:09 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:47:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrmZnPfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:47:13 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:47:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:47:13 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:47:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:47:13 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:47:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[72957f5d-dc6f-4587-ab35-25a2a7e9e179]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:47:13 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aa6bdb-c256-4963-89f9-2aa1463e33ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a] added
Aug 17 21:47:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dcb0bb-f51e-4acf-a918-87991a86ae19]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe11715-659d-4440-a8d2-2e64158745e3]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrmZnPfj {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrmZnPfj" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cc2730-6809-4ed9-9e3c-36448b9c90fa]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JrmZnPfj'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98f8830-2328-4165-9106-54d26724dbab]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b720704-d714-406d-9692-ef095201f2be]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:47:14 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:47:14 user nova-compute[72818]:  {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:47:14 user nova-compute[72818]: WARNING os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 21:47:14 user nova-compute[72818]: 
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[513019a4-9de2-4516-b98d-7ca9f48566ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a, portal: 172.16.0.220,3260]
Aug 17 21:47:14 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a, portal: 172.16.0.220,3260] successful.
Aug 17 21:47:14 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eded41d6-d6a4-4923-90d0-53b1952fcaae]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff297fb-3a45-445a-ae97-c9b0d10cb107]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a (non-flash)
Aug 17 21:47:14 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a (non-flash)
Aug 17 21:47:14 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf9ed61-b13a-430e-a6da-a372f9e18b37]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:47:15 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:47:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrmZnPfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:47:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:47:15 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26139636639666163', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:47:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139636639666163', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:47:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'flavor' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:47:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:47:15 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:47:15 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:47:15 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:47:15 user nova-compute[72818]:   <serial>23b4f386-23d3-478e-a069-3605fe9abe9a</serial>
Aug 17 21:47:15 user nova-compute[72818]: </disk>
Aug 17 21:47:15 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:47:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:47:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:47:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] No VIF found with MAC fa:16:3e:60:8b:76, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:47:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9b3b4369-1047-4fae-a0de-81a078fb1af6 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.318s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:15 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:47:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:17 user nova-compute[72818]: INFO nova.compute.manager [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Detaching volume 23b4f386-23d3-478e-a069-3605fe9abe9a
Aug 17 21:47:17 user nova-compute[72818]: INFO nova.virt.block_device [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Attempting to driver detach volume 23b4f386-23d3-478e-a069-3605fe9abe9a from mountpoint /dev/vdb
Aug 17 21:47:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Attempting to detach device vdb from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:47:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:47:17 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:47:17 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:47:17 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:47:17 user nova-compute[72818]:   <serial>23b4f386-23d3-478e-a069-3605fe9abe9a</serial>
Aug 17 21:47:17 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:47:17 user nova-compute[72818]: </disk>
Aug 17 21:47:17 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:47:17 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Successfully detached device vdb from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the persistent domain config.
Aug 17 21:47:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:47:17 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:47:17 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:47:17 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:47:17 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:47:17 user nova-compute[72818]:   <serial>23b4f386-23d3-478e-a069-3605fe9abe9a</serial>
Aug 17 21:47:17 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:47:17 user nova-compute[72818]: </disk>
Aug 17 21:47:17 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692308838.3648763, ff7cf0b9-d00e-4595-a279-79d9e7a4801d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:47:18 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Successfully detached device vdb from instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d from the live domain config.
Aug 17 21:47:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrmZnPfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:47:18 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2665139f-a232-4792-a83c-97d642b41e73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba44e7f9-5a56-4f8b-a8e9-bd18a0a3e88a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a (non-flash)
Aug 17 21:47:18 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a (non-flash)
Aug 17 21:47:18 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f28592d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6871404c-967b-4ca0-9dc6-f71fe09e8e53]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a9ac92-37ed-480f-8abb-26da149f2f6e]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[410d026d-914b-4ad1-b700-afeb0230f1fa]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[365a1dc9-be87-4a24-a344-dbd0260ba1ef]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf3a3ff-3035-40a9-b2c1-aa3112d56326]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e3388d-2c26-4b04-809a-da7d75651761]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a, portal: 172.16.0.220,3260]
Aug 17 21:47:18 user nova-compute[72818]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a, portal: 172.16.0.220,3260] successful.
Aug 17 21:47:18 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b4f386-23d3-478e-a069-3605fe9abe9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a28a858-5228-4def-a834-b4777253c602]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] <== disconnect_volume: return (291ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-d60e8d2b-3882-4c46-99cf-4fad2acf6897" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-d60e8d2b-3882-4c46-99cf-4fad2acf6897" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:47:18 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:47:19 user nova-compute[72818]: DEBUG nova.objects.instance [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'flavor' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:47:19 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Updating instance_info_cache with network_info: [{"id": "79fb84b1-9e06-4002-8b96-3f966a12639f", "address": "fa:16:3e:17:04:1c", "network": {"id": "96bcd9a6-7e50-4116-83d4-462035198c52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-203350382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871c508928564101ad0a1dab7a890f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fb84b1-9e", "ovs_interfaceid": "79fb84b1-9e06-4002-8b96-3f966a12639f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:47:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-d60e8d2b-3882-4c46-99cf-4fad2acf6897" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:47:19 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:47:19 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:47:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-8107f66e-083f-451b-9759-641850231609 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.686s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:19 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:47:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:19 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:19 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:47:19 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:20 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:47:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:47:21 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:47:21 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:47:21 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8279MB free_disk=25.205631256103516GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:47:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:22 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:47:22 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance d60e8d2b-3882-4c46-99cf-4fad2acf6897 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:47:22 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 7c1f5584-1f4a-4c09-80ba-774d013ea1bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:47:22 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 2551d322-916b-4b81-9e50-7c174108b741 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:47:22 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:47:22 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:47:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:22 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:47:22 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:47:22 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:47:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:27 user nova-compute[72818]: INFO nova.compute.manager [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Terminating instance
Aug 17 21:47:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-83016843-121a-46eb-9f17-2d502bfd55bd req-7b90dabd-a8e9-493e-ba31-9b6bcaf4e12f service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Received event network-vif-unplugged-326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-83016843-121a-46eb-9f17-2d502bfd55bd req-7b90dabd-a8e9-493e-ba31-9b6bcaf4e12f service nova] Acquiring lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-83016843-121a-46eb-9f17-2d502bfd55bd req-7b90dabd-a8e9-493e-ba31-9b6bcaf4e12f service nova] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-83016843-121a-46eb-9f17-2d502bfd55bd req-7b90dabd-a8e9-493e-ba31-9b6bcaf4e12f service nova] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-83016843-121a-46eb-9f17-2d502bfd55bd req-7b90dabd-a8e9-493e-ba31-9b6bcaf4e12f service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] No waiting events found dispatching network-vif-unplugged-326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-83016843-121a-46eb-9f17-2d502bfd55bd req-7b90dabd-a8e9-493e-ba31-9b6bcaf4e12f service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Received event network-vif-unplugged-326cae3e-69af-488f-9451-59f04fff1402 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Instance destroyed successfully.
Aug 17 21:47:28 user nova-compute[72818]: DEBUG nova.objects.instance [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'resources' on Instance uuid 7c1f5584-1f4a-4c09-80ba-774d013ea1bd {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1650606121',display_name='tempest-AttachVolumeNegativeTest-server-1650606121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1650606121',id=48,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHsA8twxBINebilZqZU75JyIiM27NmK8LOxHulimMd3ZfggAFXP+djxmoMV3mqnX8ow9NDQBUgEK2CRgk+OTUz+9bTIu5V65LERPAoSGxM7S+2u6heHrkHKd7xAT03oug==',key_name='tempest-keypair-271330191',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:44:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ffd845455a84fbf9e1517ffe2af001c',ramdisk_id='',reservation_id='r-ola7cu5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2048664550',owner_user_name='tempest-AttachVolumeNegativeTest-2048664550-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:44:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d025fb1e3974f5d91a7086343bbe5e1',uuid=7c1f5584-1f4a-4c09-80ba-774d013ea1bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "326cae3e-69af-488f-9451-59f04fff1402", "address": "fa:16:3e:76:53:eb", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326cae3e-69", "ovs_interfaceid": "326cae3e-69af-488f-9451-59f04fff1402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converting VIF {"id": "326cae3e-69af-488f-9451-59f04fff1402", "address": "fa:16:3e:76:53:eb", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326cae3e-69", "ovs_interfaceid": "326cae3e-69af-488f-9451-59f04fff1402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:53:eb,bridge_name='br-int',has_traffic_filtering=True,id=326cae3e-69af-488f-9451-59f04fff1402,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326cae3e-69') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG os_vif [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:53:eb,bridge_name='br-int',has_traffic_filtering=True,id=326cae3e-69af-488f-9451-59f04fff1402,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326cae3e-69') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap326cae3e-69, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:47:28 user nova-compute[72818]: INFO os_vif [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:53:eb,bridge_name='br-int',has_traffic_filtering=True,id=326cae3e-69af-488f-9451-59f04fff1402,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326cae3e-69')
Aug 17 21:47:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Deleting instance files /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd_del
Aug 17 21:47:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Deletion of /opt/stack/data/nova/instances/7c1f5584-1f4a-4c09-80ba-774d013ea1bd_del complete
Aug 17 21:47:28 user nova-compute[72818]: INFO nova.compute.manager [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 21:47:28 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:47:28 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:47:29 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:47:29 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Took 0.85 seconds to deallocate network for instance.
Aug 17 21:47:29 user nova-compute[72818]: DEBUG nova.compute.manager [req-75e157ba-e718-4041-8ade-b54dcdc543a2 req-f3ce5ef2-ac47-43d9-b930-3f60f68051b2 service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Received event network-vif-deleted-326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:47:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:29 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:47:29 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:47:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:29 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Deleted allocations for instance 7c1f5584-1f4a-4c09-80ba-774d013ea1bd
Aug 17 21:47:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-77bddfbb-a6f4-477d-8df6-c409154beb9c tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.043s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-da8f4f30-930b-4865-8c42-5bd0153b035f req-acf6a4ef-1a7f-493e-a61e-7e661f7f727a service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Received event network-vif-plugged-326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:47:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-da8f4f30-930b-4865-8c42-5bd0153b035f req-acf6a4ef-1a7f-493e-a61e-7e661f7f727a service nova] Acquiring lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-da8f4f30-930b-4865-8c42-5bd0153b035f req-acf6a4ef-1a7f-493e-a61e-7e661f7f727a service nova] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-da8f4f30-930b-4865-8c42-5bd0153b035f req-acf6a4ef-1a7f-493e-a61e-7e661f7f727a service nova] Lock "7c1f5584-1f4a-4c09-80ba-774d013ea1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-da8f4f30-930b-4865-8c42-5bd0153b035f req-acf6a4ef-1a7f-493e-a61e-7e661f7f727a service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] No waiting events found dispatching network-vif-plugged-326cae3e-69af-488f-9451-59f04fff1402 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:47:30 user nova-compute[72818]: WARNING nova.compute.manager [req-da8f4f30-930b-4865-8c42-5bd0153b035f req-acf6a4ef-1a7f-493e-a61e-7e661f7f727a service nova] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Received unexpected event network-vif-plugged-326cae3e-69af-488f-9451-59f04fff1402 for instance with vm_state deleted and task_state None.
Aug 17 21:47:30 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:47:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:38 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:47:43 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308848.516284, 7c1f5584-1f4a-4c09-80ba-774d013ea1bd => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:47:43 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] VM Stopped (Lifecycle Event)
Aug 17 21:47:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-5acd169e-bb8a-4dcf-b75c-1693c6d6e750 None None] [instance: 7c1f5584-1f4a-4c09-80ba-774d013ea1bd] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:47:43 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:48 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:47:53 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:54 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:54 user nova-compute[72818]: INFO nova.compute.manager [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Terminating instance
Aug 17 21:47:54 user nova-compute[72818]: DEBUG nova.compute.manager [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:47:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2fc33c4-ce2b-45ba-81c2-6335507762bc req-c0cf6678-0009-4981-8a3d-0941f06e44a0 service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Received event network-vif-unplugged-79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2fc33c4-ce2b-45ba-81c2-6335507762bc req-c0cf6678-0009-4981-8a3d-0941f06e44a0 service nova] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2fc33c4-ce2b-45ba-81c2-6335507762bc req-c0cf6678-0009-4981-8a3d-0941f06e44a0 service nova] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d2fc33c4-ce2b-45ba-81c2-6335507762bc req-c0cf6678-0009-4981-8a3d-0941f06e44a0 service nova] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2fc33c4-ce2b-45ba-81c2-6335507762bc req-c0cf6678-0009-4981-8a3d-0941f06e44a0 service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] No waiting events found dispatching network-vif-unplugged-79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG nova.compute.manager [req-d2fc33c4-ce2b-45ba-81c2-6335507762bc req-c0cf6678-0009-4981-8a3d-0941f06e44a0 service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Received event network-vif-unplugged-79fb84b1-9e06-4002-8b96-3f966a12639f for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:47:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Instance destroyed successfully.
Aug 17 21:47:55 user nova-compute[72818]: DEBUG nova.objects.instance [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lazy-loading 'resources' on Instance uuid d60e8d2b-3882-4c46-99cf-4fad2acf6897 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1993215180',display_name='tempest-TestServerVolumeAttachmentScenario-server-1993215180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1993215180',id=47,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB9HabASo4AtUAoKvW95I2Yb4oCzp+ni3w4R+8vbCvQ2yJDJfvbmpZBmyEkf16dtbt6MZBzeWfuGtwoWW8grWsXats4TJGqpIw0E12CsXCv5QxI8wL42E29U2J5h2TIcA==',key_name='tempest-keypair-1042673641',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:43:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='871c508928564101ad0a1dab7a890f49',ramdisk_id='',reservation_id='r-t7wf9k1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1671956283',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1671956283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1329fecf5b2493ab0bea875e2151c34',uuid=d60e8d2b-3882-4c46-99cf-4fad2acf6897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79fb84b1-9e06-4002-8b96-3f966a12639f", "address": "fa:16:3e:17:04:1c", "network": {"id": "96bcd9a6-7e50-4116-83d4-462035198c52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-203350382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871c508928564101ad0a1dab7a890f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fb84b1-9e", "ovs_interfaceid": "79fb84b1-9e06-4002-8b96-3f966a12639f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Converting VIF {"id": "79fb84b1-9e06-4002-8b96-3f966a12639f", "address": "fa:16:3e:17:04:1c", "network": {"id": "96bcd9a6-7e50-4116-83d4-462035198c52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-203350382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871c508928564101ad0a1dab7a890f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fb84b1-9e", "ovs_interfaceid": "79fb84b1-9e06-4002-8b96-3f966a12639f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:04:1c,bridge_name='br-int',has_traffic_filtering=True,id=79fb84b1-9e06-4002-8b96-3f966a12639f,network=Network(96bcd9a6-7e50-4116-83d4-462035198c52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fb84b1-9e') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG os_vif [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:04:1c,bridge_name='br-int',has_traffic_filtering=True,id=79fb84b1-9e06-4002-8b96-3f966a12639f,network=Network(96bcd9a6-7e50-4116-83d4-462035198c52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fb84b1-9e') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79fb84b1-9e, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:47:55 user nova-compute[72818]: INFO os_vif [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:04:1c,bridge_name='br-int',has_traffic_filtering=True,id=79fb84b1-9e06-4002-8b96-3f966a12639f,network=Network(96bcd9a6-7e50-4116-83d4-462035198c52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fb84b1-9e')
Aug 17 21:47:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Deleting instance files /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897_del
Aug 17 21:47:55 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Deletion of /opt/stack/data/nova/instances/d60e8d2b-3882-4c46-99cf-4fad2acf6897_del complete
Aug 17 21:47:55 user nova-compute[72818]: INFO nova.compute.manager [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 21:47:55 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:47:55 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:47:56 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:47:56 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Took 1.14 seconds to deallocate network for instance.
Aug 17 21:47:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-065e23a8-9aa9-4932-9fb5-96b2a51aa639 req-756215ad-5466-4ea0-844d-6117e4843841 service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Received event network-vif-deleted-79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:47:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:57 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:47:57 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:47:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:57 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Deleted allocations for instance d60e8d2b-3882-4c46-99cf-4fad2acf6897
Aug 17 21:47:57 user nova-compute[72818]: DEBUG nova.compute.manager [req-acfdbcd8-3806-4448-a89c-350ee72da6ee req-7f10c66f-6b6f-4f99-80fd-412b8920d41a service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Received event network-vif-plugged-79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:47:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-acfdbcd8-3806-4448-a89c-350ee72da6ee req-7f10c66f-6b6f-4f99-80fd-412b8920d41a service nova] Acquiring lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:47:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-acfdbcd8-3806-4448-a89c-350ee72da6ee req-7f10c66f-6b6f-4f99-80fd-412b8920d41a service nova] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:47:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-acfdbcd8-3806-4448-a89c-350ee72da6ee req-7f10c66f-6b6f-4f99-80fd-412b8920d41a service nova] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:47:57 user nova-compute[72818]: DEBUG nova.compute.manager [req-acfdbcd8-3806-4448-a89c-350ee72da6ee req-7f10c66f-6b6f-4f99-80fd-412b8920d41a service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] No waiting events found dispatching network-vif-plugged-79fb84b1-9e06-4002-8b96-3f966a12639f {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:47:57 user nova-compute[72818]: WARNING nova.compute.manager [req-acfdbcd8-3806-4448-a89c-350ee72da6ee req-7f10c66f-6b6f-4f99-80fd-412b8920d41a service nova] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Received unexpected event network-vif-plugged-79fb84b1-9e06-4002-8b96-3f966a12639f for instance with vm_state deleted and task_state None.
Aug 17 21:47:57 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-406177d5-5ae7-4810-b22d-c87088fef673 tempest-TestServerVolumeAttachmentScenario-1671956283 tempest-TestServerVolumeAttachmentScenario-1671956283-project-member] Lock "d60e8d2b-3882-4c46-99cf-4fad2acf6897" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.337s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:48:10 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308875.6410847, d60e8d2b-3882-4c46-99cf-4fad2acf6897 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:48:10 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] VM Stopped (Lifecycle Event)
Aug 17 21:48:10 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3b1b6382-da80-4140-9c53-3c3aa09c32f7 None None] [instance: d60e8d2b-3882-4c46-99cf-4fad2acf6897] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:48:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:11 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:48:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:48:14 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:48:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:48:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:48:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:48:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:48:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:17 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:48:18 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:48:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:20 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:48:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:48:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 21:48:21 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:48:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:21 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:48:21 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "3173752d-5125-492c-9358-788c2dbb7ba5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "3173752d-5125-492c-9358-788c2dbb7ba5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:48:22 user nova-compute[72818]: INFO nova.compute.claims [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Claim successful on node user
Aug 17 21:48:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG nova.network.neutron [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:48:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:48:22 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:48:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.policy [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d025fb1e3974f5d91a7086343bbe5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffd845455a84fbf9e1517ffe2af001c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:48:23 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:48:23 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8558MB free_disk=25.26010513305664GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:48:23 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Creating image(s)
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "/opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "/opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "/opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 2551d322-916b-4b81-9e50-7c174108b741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 3173752d-5125-492c-9358-788c2dbb7ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk 1073741824" returned: 0 in 0.049s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:48:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Successfully created port: 83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Cannot resize image /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG nova.objects.instance [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'migration_context' on Instance uuid 3173752d-5125-492c-9358-788c2dbb7ba5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Ensure instance console log exists: /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Successfully updated port: 83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquired lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-848bb6a7-3d2b-4ba8-91db-659995e51a4e req-2ab6a220-1ad9-4f58-935b-528dc32b9d70 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Received event network-changed-83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-848bb6a7-3d2b-4ba8-91db-659995e51a4e req-2ab6a220-1ad9-4f58-935b-528dc32b9d70 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Refreshing instance network info cache due to event network-changed-83d35f92-11a5-46e8-9d1b-33a8328f45ac. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-848bb6a7-3d2b-4ba8-91db-659995e51a4e req-2ab6a220-1ad9-4f58-935b-528dc32b9d70 service nova] Acquiring lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:48:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.network.neutron [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Updating instance_info_cache with network_info: [{"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Releasing lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Instance network_info: |[{"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-848bb6a7-3d2b-4ba8-91db-659995e51a4e req-2ab6a220-1ad9-4f58-935b-528dc32b9d70 service nova] Acquired lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-848bb6a7-3d2b-4ba8-91db-659995e51a4e req-2ab6a220-1ad9-4f58-935b-528dc32b9d70 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Refreshing network info cache for port 83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Start _get_guest_xml network_info=[{"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:48:25 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:48:25 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-159121961',display_name='tempest-AttachVolumeNegativeTest-server-159121961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-159121961',id=49,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNepYhi0DdkCeHgDr1imn8BINAXyTO28/vHVYsuiqGSP/ltZX7zfhcitZbqXDk63fmxrKmuydxD7w7GZH5JTCwtCjKvgQVc46Ok4iVqAhKW5BwxLqQZiOHQ2CGeeZXH7XA==',key_name='tempest-keypair-1367773031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ffd845455a84fbf9e1517ffe2af001c',ramdisk_id='',reservation_id='r-adovi85c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2048664550',owner_user_name='tempest-AttachVolumeNegativeTest-2048664550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d025fb1e3974f5d91a7086343bbe5e1',uuid=3173752d-5125-492c-9358-788c2dbb7ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converting VIF {"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=83d35f92-11a5-46e8-9d1b-33a8328f45ac,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d35f92-11') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.objects.instance [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'pci_devices' on Instance uuid 3173752d-5125-492c-9358-788c2dbb7ba5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:48:25 user nova-compute[72818]:   <uuid>3173752d-5125-492c-9358-788c2dbb7ba5</uuid>
Aug 17 21:48:25 user nova-compute[72818]:   <name>instance-00000031</name>
Aug 17 21:48:25 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:48:25 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:48:25 user nova-compute[72818]:   <metadata>
Aug 17 21:48:25 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:48:25 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:48:25 user nova-compute[72818]:       <nova:name>tempest-AttachVolumeNegativeTest-server-159121961</nova:name>
Aug 17 21:48:25 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:48:25</nova:creationTime>
Aug 17 21:48:25 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:48:25 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:48:25 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:48:25 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:48:25 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:48:25 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:48:25 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:48:25 user nova-compute[72818]:       <nova:owner>
Aug 17 21:48:25 user nova-compute[72818]:         <nova:user uuid="4d025fb1e3974f5d91a7086343bbe5e1">tempest-AttachVolumeNegativeTest-2048664550-project-member</nova:user>
Aug 17 21:48:25 user nova-compute[72818]:         <nova:project uuid="7ffd845455a84fbf9e1517ffe2af001c">tempest-AttachVolumeNegativeTest-2048664550</nova:project>
Aug 17 21:48:25 user nova-compute[72818]:       </nova:owner>
Aug 17 21:48:25 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:48:25 user nova-compute[72818]:       <nova:ports>
Aug 17 21:48:25 user nova-compute[72818]:         <nova:port uuid="83d35f92-11a5-46e8-9d1b-33a8328f45ac">
Aug 17 21:48:25 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 21:48:25 user nova-compute[72818]:         </nova:port>
Aug 17 21:48:25 user nova-compute[72818]:       </nova:ports>
Aug 17 21:48:25 user nova-compute[72818]:     </nova:instance>
Aug 17 21:48:25 user nova-compute[72818]:   </metadata>
Aug 17 21:48:25 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:48:25 user nova-compute[72818]:     <system>
Aug 17 21:48:25 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:48:25 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:48:25 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:48:25 user nova-compute[72818]:       <entry name="serial">3173752d-5125-492c-9358-788c2dbb7ba5</entry>
Aug 17 21:48:25 user nova-compute[72818]:       <entry name="uuid">3173752d-5125-492c-9358-788c2dbb7ba5</entry>
Aug 17 21:48:25 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:48:25 user nova-compute[72818]:     </system>
Aug 17 21:48:25 user nova-compute[72818]:   </sysinfo>
Aug 17 21:48:25 user nova-compute[72818]:   <os>
Aug 17 21:48:25 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:48:25 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:48:25 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:48:25 user nova-compute[72818]:   </os>
Aug 17 21:48:25 user nova-compute[72818]:   <features>
Aug 17 21:48:25 user nova-compute[72818]:     <acpi/>
Aug 17 21:48:25 user nova-compute[72818]:     <apic/>
Aug 17 21:48:25 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:48:25 user nova-compute[72818]:   </features>
Aug 17 21:48:25 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:48:25 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:48:25 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:48:25 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:48:25 user nova-compute[72818]:   </clock>
Aug 17 21:48:25 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:48:25 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:48:25 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:48:25 user nova-compute[72818]:   </cpu>
Aug 17 21:48:25 user nova-compute[72818]:   <devices>
Aug 17 21:48:25 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:48:25 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:48:25 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk"/>
Aug 17 21:48:25 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:48:25 user nova-compute[72818]:     </disk>
Aug 17 21:48:25 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:48:25 user nova-compute[72818]:       <mac address="fa:16:3e:38:4b:72"/>
Aug 17 21:48:25 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:48:25 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:48:25 user nova-compute[72818]:       <target dev="tap83d35f92-11"/>
Aug 17 21:48:25 user nova-compute[72818]:     </interface>
Aug 17 21:48:25 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:48:25 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/console.log" append="off"/>
Aug 17 21:48:25 user nova-compute[72818]:     </serial>
Aug 17 21:48:25 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:48:25 user nova-compute[72818]:     <video>
Aug 17 21:48:25 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:48:25 user nova-compute[72818]:     </video>
Aug 17 21:48:25 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:48:25 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:48:25 user nova-compute[72818]:     </rng>
Aug 17 21:48:25 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:48:25 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:48:25 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:48:25 user nova-compute[72818]:     </memballoon>
Aug 17 21:48:25 user nova-compute[72818]:   </devices>
Aug 17 21:48:25 user nova-compute[72818]: </domain>
Aug 17 21:48:25 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-159121961',display_name='tempest-AttachVolumeNegativeTest-server-159121961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-159121961',id=49,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNepYhi0DdkCeHgDr1imn8BINAXyTO28/vHVYsuiqGSP/ltZX7zfhcitZbqXDk63fmxrKmuydxD7w7GZH5JTCwtCjKvgQVc46Ok4iVqAhKW5BwxLqQZiOHQ2CGeeZXH7XA==',key_name='tempest-keypair-1367773031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ffd845455a84fbf9e1517ffe2af001c',ramdisk_id='',reservation_id='r-adovi85c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2048664550',owner_user_name='tempest-AttachVolumeNegativeTest-2048664550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d025fb1e3974f5d91a7086343bbe5e1',uuid=3173752d-5125-492c-9358-788c2dbb7ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converting VIF {"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=83d35f92-11a5-46e8-9d1b-33a8328f45ac,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d35f92-11') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG os_vif [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=83d35f92-11a5-46e8-9d1b-33a8328f45ac,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d35f92-11') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83d35f92-11, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83d35f92-11, col_values=(('external_ids', {'iface-id': '83d35f92-11a5-46e8-9d1b-33a8328f45ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:4b:72', 'vm-uuid': '3173752d-5125-492c-9358-788c2dbb7ba5'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:25 user nova-compute[72818]: INFO os_vif [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=83d35f92-11a5-46e8-9d1b-33a8328f45ac,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d35f92-11')
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No VIF found with MAC fa:16:3e:38:4b:72, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-848bb6a7-3d2b-4ba8-91db-659995e51a4e req-2ab6a220-1ad9-4f58-935b-528dc32b9d70 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Updated VIF entry in instance network info cache for port 83d35f92-11a5-46e8-9d1b-33a8328f45ac. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG nova.network.neutron [req-848bb6a7-3d2b-4ba8-91db-659995e51a4e req-2ab6a220-1ad9-4f58-935b-528dc32b9d70 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Updating instance_info_cache with network_info: [{"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:48:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-848bb6a7-3d2b-4ba8-91db-659995e51a4e req-2ab6a220-1ad9-4f58-935b-528dc32b9d70 service nova] Releasing lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:48:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:48:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:48:26 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:48:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-754bed13-3bfc-4286-a29f-dbf143acffa3 req-13d4be75-1793-4b9b-a1cf-7d4a3d1b92b6 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Received event network-vif-plugged-83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:48:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-754bed13-3bfc-4286-a29f-dbf143acffa3 req-13d4be75-1793-4b9b-a1cf-7d4a3d1b92b6 service nova] Acquiring lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-754bed13-3bfc-4286-a29f-dbf143acffa3 req-13d4be75-1793-4b9b-a1cf-7d4a3d1b92b6 service nova] Lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-754bed13-3bfc-4286-a29f-dbf143acffa3 req-13d4be75-1793-4b9b-a1cf-7d4a3d1b92b6 service nova] Lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-754bed13-3bfc-4286-a29f-dbf143acffa3 req-13d4be75-1793-4b9b-a1cf-7d4a3d1b92b6 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] No waiting events found dispatching network-vif-plugged-83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:48:26 user nova-compute[72818]: WARNING nova.compute.manager [req-754bed13-3bfc-4286-a29f-dbf143acffa3 req-13d4be75-1793-4b9b-a1cf-7d4a3d1b92b6 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Received unexpected event network-vif-plugged-83d35f92-11a5-46e8-9d1b-33a8328f45ac for instance with vm_state building and task_state spawning.
Aug 17 21:48:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308908.6300278, 3173752d-5125-492c-9358-788c2dbb7ba5 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:48:28 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] VM Resumed (Lifecycle Event)
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:48:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Instance spawned successfully.
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:48:28 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692308908.633534, 3173752d-5125-492c-9358-788c2dbb7ba5 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:48:28 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] VM Started (Lifecycle Event)
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:48:28 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:48:28 user nova-compute[72818]: INFO nova.compute.manager [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:48:28 user nova-compute[72818]: INFO nova.compute.manager [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Took 6.55 seconds to build instance.
Aug 17 21:48:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-84e5ea65-f907-45d7-ad7f-15d6ad9a84c9 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "3173752d-5125-492c-9358-788c2dbb7ba5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.647s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-91449cef-4bfb-4acb-8e92-a8195a3c4ac7 req-47ff25a4-a78f-49a4-91aa-035e51eab644 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Received event network-vif-plugged-83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-91449cef-4bfb-4acb-8e92-a8195a3c4ac7 req-47ff25a4-a78f-49a4-91aa-035e51eab644 service nova] Acquiring lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-91449cef-4bfb-4acb-8e92-a8195a3c4ac7 req-47ff25a4-a78f-49a4-91aa-035e51eab644 service nova] Lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-91449cef-4bfb-4acb-8e92-a8195a3c4ac7 req-47ff25a4-a78f-49a4-91aa-035e51eab644 service nova] Lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-91449cef-4bfb-4acb-8e92-a8195a3c4ac7 req-47ff25a4-a78f-49a4-91aa-035e51eab644 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] No waiting events found dispatching network-vif-plugged-83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:48:28 user nova-compute[72818]: WARNING nova.compute.manager [req-91449cef-4bfb-4acb-8e92-a8195a3c4ac7 req-47ff25a4-a78f-49a4-91aa-035e51eab644 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Received unexpected event network-vif-plugged-83d35f92-11a5-46e8-9d1b-33a8328f45ac for instance with vm_state active and task_state None.
Aug 17 21:48:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "2551d322-916b-4b81-9e50-7c174108b741" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:35 user nova-compute[72818]: INFO nova.compute.manager [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Terminating instance
Aug 17 21:48:35 user nova-compute[72818]: DEBUG nova.compute.manager [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:48:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-d07c044f-2058-4915-874c-1f62e192a4a6 req-0975aab4-c7ae-4c18-a2fa-c11d4ac96f66 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-vif-unplugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d07c044f-2058-4915-874c-1f62e192a4a6 req-0975aab4-c7ae-4c18-a2fa-c11d4ac96f66 service nova] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d07c044f-2058-4915-874c-1f62e192a4a6 req-0975aab4-c7ae-4c18-a2fa-c11d4ac96f66 service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d07c044f-2058-4915-874c-1f62e192a4a6 req-0975aab4-c7ae-4c18-a2fa-c11d4ac96f66 service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-d07c044f-2058-4915-874c-1f62e192a4a6 req-0975aab4-c7ae-4c18-a2fa-c11d4ac96f66 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] No waiting events found dispatching network-vif-unplugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-d07c044f-2058-4915-874c-1f62e192a4a6 req-0975aab4-c7ae-4c18-a2fa-c11d4ac96f66 service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-vif-unplugged-b9826839-7693-451b-9051-a4a87db6e9ac for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:48:36 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Instance destroyed successfully.
Aug 17 21:48:36 user nova-compute[72818]: DEBUG nova.objects.instance [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lazy-loading 'resources' on Instance uuid 2551d322-916b-4b81-9e50-7c174108b741 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T21:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1377529842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1377529842',id=46,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDspgLsuK0Yrn4L/u+cPnmrsz3U7bF8hKZw6mIacC7jBzHbCCKbAxi+HKKhjJ0ZuHJrpFY126zMOVHFgOlvJzoSDf2KbmNaV3WHtsZGkeYThqwZyi0L+H4cNNMIKBxAHw==',key_name='tempest-keypair-581168616',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:46:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a9d9dc56ba84253be502280f64d7b59',ramdisk_id='',reservation_id='r-grwff5oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-895220279',owner_user_name='tempest-AttachVolumeShelveTestJSON-895220279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbcc7e79679c4ebb915828988321acc8',uuid=2551d322-916b-4b81-9e50-7c174108b741,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converting VIF {"id": "b9826839-7693-451b-9051-a4a87db6e9ac", "address": "fa:16:3e:4c:85:23", "network": {"id": "a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1514077254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9d9dc56ba84253be502280f64d7b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9826839-76", "ovs_interfaceid": "b9826839-7693-451b-9051-a4a87db6e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG os_vif [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9826839-76, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:48:36 user nova-compute[72818]: INFO os_vif [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:85:23,bridge_name='br-int',has_traffic_filtering=True,id=b9826839-7693-451b-9051-a4a87db6e9ac,network=Network(a5c4d7d2-8dd8-404e-a272-d0f7dcb9a601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9826839-76')
Aug 17 21:48:36 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Deleting instance files /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741_del
Aug 17 21:48:36 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Deletion of /opt/stack/data/nova/instances/2551d322-916b-4b81-9e50-7c174108b741_del complete
Aug 17 21:48:36 user nova-compute[72818]: INFO nova.compute.manager [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 21:48:36 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:48:36 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 2551d322-916b-4b81-9e50-7c174108b741] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:48:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:37 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:48:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-e046dee5-b263-42fa-a9f0-e60ca72cf972 req-6f150397-e384-4b10-882c-b6cdd6697e9e service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-vif-deleted-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:48:37 user nova-compute[72818]: INFO nova.compute.manager [req-e046dee5-b263-42fa-a9f0-e60ca72cf972 req-6f150397-e384-4b10-882c-b6cdd6697e9e service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Neutron deleted interface b9826839-7693-451b-9051-a4a87db6e9ac; detaching it from the instance and deleting it from the info cache
Aug 17 21:48:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-e046dee5-b263-42fa-a9f0-e60ca72cf972 req-6f150397-e384-4b10-882c-b6cdd6697e9e service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:48:37 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Took 0.90 seconds to deallocate network for instance.
Aug 17 21:48:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-e046dee5-b263-42fa-a9f0-e60ca72cf972 req-6f150397-e384-4b10-882c-b6cdd6697e9e service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Detach interface failed, port_id=b9826839-7693-451b-9051-a4a87db6e9ac, reason: Instance 2551d322-916b-4b81-9e50-7c174108b741 could not be found. {{(pid=72818) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 21:48:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:37 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:48:37 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:48:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:38 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Deleted allocations for instance 2551d322-916b-4b81-9e50-7c174108b741
Aug 17 21:48:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-346aea76-9c77-4158-ad23-0c2d0723505f tempest-AttachVolumeShelveTestJSON-895220279 tempest-AttachVolumeShelveTestJSON-895220279-project-member] Lock "2551d322-916b-4b81-9e50-7c174108b741" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.325s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-72a88b6b-366a-4674-aff7-8ae310519a10 req-ce2c47c0-992e-4c04-9c25-fa8f39e7410d service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received event network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:48:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-72a88b6b-366a-4674-aff7-8ae310519a10 req-ce2c47c0-992e-4c04-9c25-fa8f39e7410d service nova] Acquiring lock "2551d322-916b-4b81-9e50-7c174108b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-72a88b6b-366a-4674-aff7-8ae310519a10 req-ce2c47c0-992e-4c04-9c25-fa8f39e7410d service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-72a88b6b-366a-4674-aff7-8ae310519a10 req-ce2c47c0-992e-4c04-9c25-fa8f39e7410d service nova] Lock "2551d322-916b-4b81-9e50-7c174108b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-72a88b6b-366a-4674-aff7-8ae310519a10 req-ce2c47c0-992e-4c04-9c25-fa8f39e7410d service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] No waiting events found dispatching network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:48:38 user nova-compute[72818]: WARNING nova.compute.manager [req-72a88b6b-366a-4674-aff7-8ae310519a10 req-ce2c47c0-992e-4c04-9c25-fa8f39e7410d service nova] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Received unexpected event network-vif-plugged-b9826839-7693-451b-9051-a4a87db6e9ac for instance with vm_state deleted and task_state None.
Aug 17 21:48:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:48:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:51 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308916.6024075, 2551d322-916b-4b81-9e50-7c174108b741 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:48:51 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 2551d322-916b-4b81-9e50-7c174108b741] VM Stopped (Lifecycle Event)
Aug 17 21:48:51 user nova-compute[72818]: DEBUG nova.compute.manager [None req-18a1cfe5-c803-4632-87f0-52cf678e16da None None] [instance: 2551d322-916b-4b81-9e50-7c174108b741] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:48:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:56 user nova-compute[72818]: INFO nova.compute.manager [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Terminating instance
Aug 17 21:48:56 user nova-compute[72818]: DEBUG nova.compute.manager [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-efbc88c9-777e-455b-8b3d-f972b05687f4 req-81ff0195-0ab7-46aa-8c64-369ae4a9daa4 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Received event network-vif-unplugged-bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-efbc88c9-777e-455b-8b3d-f972b05687f4 req-81ff0195-0ab7-46aa-8c64-369ae4a9daa4 service nova] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-efbc88c9-777e-455b-8b3d-f972b05687f4 req-81ff0195-0ab7-46aa-8c64-369ae4a9daa4 service nova] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-efbc88c9-777e-455b-8b3d-f972b05687f4 req-81ff0195-0ab7-46aa-8c64-369ae4a9daa4 service nova] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-efbc88c9-777e-455b-8b3d-f972b05687f4 req-81ff0195-0ab7-46aa-8c64-369ae4a9daa4 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] No waiting events found dispatching network-vif-unplugged-bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:48:56 user nova-compute[72818]: DEBUG nova.compute.manager [req-efbc88c9-777e-455b-8b3d-f972b05687f4 req-81ff0195-0ab7-46aa-8c64-369ae4a9daa4 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Received event network-vif-unplugged-bdbc800c-9778-4fed-ba1f-202cf9d03d75 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:48:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Instance destroyed successfully.
Aug 17 21:48:57 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lazy-loading 'resources' on Instance uuid ff7cf0b9-d00e-4595-a279-79d9e7a4801d {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:48:57 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2074664928',display_name='tempest-SnapshotDataIntegrityTests-server-2074664928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2074664928',id=43,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ5rkzJDoxZs+DN6SJ1o7MGb6eJoD4/UvqZZGvk3H2VgAtiZUfJoTV1LdtGmkgaHkO2dwDHzwygEzedXQBXloZCewTW9fpW5A4qtWMqNOVU+5gMDyv8DRwCajB2VAz1cQ==',key_name='tempest-keypair-1967081089',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:41:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d01ed6842244a2f88a95aa8a29f7eae',ramdisk_id='',reservation_id='r-ois28i0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1922492630',owner_user_name='tempest-SnapshotDataIntegrityTests-1922492630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:41:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='214fa313bcc84892928f43a023ab2b1c',uuid=ff7cf0b9-d00e-4595-a279-79d9e7a4801d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:48:57 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Converting VIF {"id": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "address": "fa:16:3e:60:8b:76", "network": {"id": "83fa75b6-42f0-483f-8a93-5606e6fb6971", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1102832644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d01ed6842244a2f88a95aa8a29f7eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc800c-97", "ovs_interfaceid": "bdbc800c-9778-4fed-ba1f-202cf9d03d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:48:57 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:8b:76,bridge_name='br-int',has_traffic_filtering=True,id=bdbc800c-9778-4fed-ba1f-202cf9d03d75,network=Network(83fa75b6-42f0-483f-8a93-5606e6fb6971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc800c-97') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:48:57 user nova-compute[72818]: DEBUG os_vif [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:8b:76,bridge_name='br-int',has_traffic_filtering=True,id=bdbc800c-9778-4fed-ba1f-202cf9d03d75,network=Network(83fa75b6-42f0-483f-8a93-5606e6fb6971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc800c-97') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:48:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdbc800c-97, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:48:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:48:57 user nova-compute[72818]: INFO os_vif [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:8b:76,bridge_name='br-int',has_traffic_filtering=True,id=bdbc800c-9778-4fed-ba1f-202cf9d03d75,network=Network(83fa75b6-42f0-483f-8a93-5606e6fb6971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc800c-97')
Aug 17 21:48:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Deleting instance files /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d_del
Aug 17 21:48:57 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Deletion of /opt/stack/data/nova/instances/ff7cf0b9-d00e-4595-a279-79d9e7a4801d_del complete
Aug 17 21:48:57 user nova-compute[72818]: INFO nova.compute.manager [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 21:48:57 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:48:57 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:48:57 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:48:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:48:58 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:48:58 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Took 1.12 seconds to deallocate network for instance.
Aug 17 21:48:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-0800284e-7b5c-42f5-98ce-b2acec2ce7e5 req-7da55c49-6e91-443f-9ff2-63b09a921080 service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Received event network-vif-deleted-bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:48:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:58 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:48:58 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:48:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:58 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Deleted allocations for instance ff7cf0b9-d00e-4595-a279-79d9e7a4801d
Aug 17 21:48:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f2b4f5db-2e6e-47a5-8c7b-5afd10c8dc54 tempest-SnapshotDataIntegrityTests-1922492630 tempest-SnapshotDataIntegrityTests-1922492630-project-member] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.300s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-1622432c-8139-4917-8b80-23a507b31129 req-32e08e73-e473-40f2-82d0-8cdfab415f1d service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Received event network-vif-plugged-bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:48:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1622432c-8139-4917-8b80-23a507b31129 req-32e08e73-e473-40f2-82d0-8cdfab415f1d service nova] Acquiring lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:48:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1622432c-8139-4917-8b80-23a507b31129 req-32e08e73-e473-40f2-82d0-8cdfab415f1d service nova] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:48:58 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1622432c-8139-4917-8b80-23a507b31129 req-32e08e73-e473-40f2-82d0-8cdfab415f1d service nova] Lock "ff7cf0b9-d00e-4595-a279-79d9e7a4801d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:48:58 user nova-compute[72818]: DEBUG nova.compute.manager [req-1622432c-8139-4917-8b80-23a507b31129 req-32e08e73-e473-40f2-82d0-8cdfab415f1d service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] No waiting events found dispatching network-vif-plugged-bdbc800c-9778-4fed-ba1f-202cf9d03d75 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:48:58 user nova-compute[72818]: WARNING nova.compute.manager [req-1622432c-8139-4917-8b80-23a507b31129 req-32e08e73-e473-40f2-82d0-8cdfab415f1d service nova] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Received unexpected event network-vif-plugged-bdbc800c-9778-4fed-ba1f-202cf9d03d75 for instance with vm_state deleted and task_state None.
Aug 17 21:49:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:12 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692308937.1219592, ff7cf0b9-d00e-4595-a279-79d9e7a4801d => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:49:12 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] VM Stopped (Lifecycle Event)
Aug 17 21:49:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b6fd27d0-f69b-4d8e-94f0-d553bb436830 None None] [instance: ff7cf0b9-d00e-4595-a279-79d9e7a4801d] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:49:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:13 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:49:14 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:49:16 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:49:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:49:17 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:49:18 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:49:20 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:49:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:49:20 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:49:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:49:20 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:49:20 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:49:20 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid 3173752d-5125-492c-9358-788c2dbb7ba5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:49:21 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Updating instance_info_cache with network_info: [{"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:49:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:49:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:49:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:23 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:49:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:49:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:49:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:49:23 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:49:23 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:49:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:49:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:49:24 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:49:24 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:49:24 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:49:24 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8601MB free_disk=25.277240753173828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:49:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:49:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:49:24 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 3173752d-5125-492c-9358-788c2dbb7ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:49:24 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:49:24 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:49:24 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:49:24 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:49:24 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:49:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:49:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:49:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:49:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:49:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:49:35 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:49:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:49:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:49:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:49:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Acquiring lock "5d09e155-7310-4998-8332-a47bf17f4f08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "5d09e155-7310-4998-8332-a47bf17f4f08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:12 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:50:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:12 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:50:12 user nova-compute[72818]: INFO nova.compute.claims [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Claim successful on node user
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-fb44774c-7d4e-4d1d-83bd-b4c8df385c3b req-37aaafc9-8ccf-4408-9fda-01b4c459e476 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Received event network-changed-83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-fb44774c-7d4e-4d1d-83bd-b4c8df385c3b req-37aaafc9-8ccf-4408-9fda-01b4c459e476 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Refreshing instance network info cache due to event network-changed-83d35f92-11a5-46e8-9d1b-33a8328f45ac. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fb44774c-7d4e-4d1d-83bd-b4c8df385c3b req-37aaafc9-8ccf-4408-9fda-01b4c459e476 service nova] Acquiring lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fb44774c-7d4e-4d1d-83bd-b4c8df385c3b req-37aaafc9-8ccf-4408-9fda-01b4c459e476 service nova] Acquired lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.network.neutron [req-fb44774c-7d4e-4d1d-83bd-b4c8df385c3b req-37aaafc9-8ccf-4408-9fda-01b4c459e476 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Refreshing network info cache for port 83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:50:13 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:50:13 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Creating image(s)
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "/opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "/opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.policy [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b53d5cada0da4be6a32eb7107cb0a727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad8573c46f44e8b989a57719867ee9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Acquiring lock "f01fe075652c036b83af5d179c60f228b745dd35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.network.neutron [req-fb44774c-7d4e-4d1d-83bd-b4c8df385c3b req-37aaafc9-8ccf-4408-9fda-01b4c459e476 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Updated VIF entry in instance network info cache for port 83d35f92-11a5-46e8-9d1b-33a8328f45ac. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.network.neutron [req-fb44774c-7d4e-4d1d-83bd-b4c8df385c3b req-37aaafc9-8ccf-4408-9fda-01b4c459e476 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Updating instance_info_cache with network_info: [{"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fb44774c-7d4e-4d1d-83bd-b4c8df385c3b req-37aaafc9-8ccf-4408-9fda-01b4c459e476 service nova] Releasing lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.190s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35,backing_fmt=raw /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk 1073741824" returned: 0 in 0.090s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "f01fe075652c036b83af5d179c60f228b745dd35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35 --force-share --output=json" returned: 0 in 0.194s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:50:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Successfully created port: e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Cannot resize image /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lazy-loading 'migration_context' on Instance uuid 5d09e155-7310-4998-8332-a47bf17f4f08 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Ensure instance console log exists: /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Successfully updated port: e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Acquiring lock "refresh_cache-5d09e155-7310-4998-8332-a47bf17f4f08" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Acquired lock "refresh_cache-5d09e155-7310-4998-8332-a47bf17f4f08" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:50:14 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-7fcc51e8-a808-4698-bf9f-9bf614482749 req-343c5441-43f0-461a-8fc3-f327c4c32811 service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Received event network-changed-e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-7fcc51e8-a808-4698-bf9f-9bf614482749 req-343c5441-43f0-461a-8fc3-f327c4c32811 service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Refreshing instance network info cache due to event network-changed-e9d5b3dd-1de1-4f7b-8199-414759c176f8. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7fcc51e8-a808-4698-bf9f-9bf614482749 req-343c5441-43f0-461a-8fc3-f327c4c32811 service nova] Acquiring lock "refresh_cache-5d09e155-7310-4998-8332-a47bf17f4f08" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Updating instance_info_cache with network_info: [{"id": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "address": "fa:16:3e:91:ff:b9", "network": {"id": "80bd195d-165e-4e42-a6be-467f7e03d53b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1827043037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fad8573c46f44e8b989a57719867ee9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5b3dd-1d", "ovs_interfaceid": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Releasing lock "refresh_cache-5d09e155-7310-4998-8332-a47bf17f4f08" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Instance network_info: |[{"id": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "address": "fa:16:3e:91:ff:b9", "network": {"id": "80bd195d-165e-4e42-a6be-467f7e03d53b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1827043037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fad8573c46f44e8b989a57719867ee9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5b3dd-1d", "ovs_interfaceid": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7fcc51e8-a808-4698-bf9f-9bf614482749 req-343c5441-43f0-461a-8fc3-f327c4c32811 service nova] Acquired lock "refresh_cache-5d09e155-7310-4998-8332-a47bf17f4f08" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.network.neutron [req-7fcc51e8-a808-4698-bf9f-9bf614482749 req-343c5441-43f0-461a-8fc3-f327c4c32811 service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Refreshing network info cache for port e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Start _get_guest_xml network_info=[{"id": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "address": "fa:16:3e:91:ff:b9", "network": {"id": "80bd195d-165e-4e42-a6be-467f7e03d53b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1827043037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fad8573c46f44e8b989a57719867ee9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5b3dd-1d", "ovs_interfaceid": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '18340577-52dd-4d73-ae6b-8ba3ed9c0808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:50:15 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:50:15 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:11:10Z,direct_url=<?>,disk_format='qcow2',id=18340577-52dd-4d73-ae6b-8ba3ed9c0808,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6438a8b236d74a9585300eb2b1ce044f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:11:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:50:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1886298417',display_name='tempest-VolumesActionsTest-instance-1886298417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1886298417',id=50,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fad8573c46f44e8b989a57719867ee9e',ramdisk_id='',reservation_id='r-7fw6saq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1246193084',owner_user_name='tempest-VolumesActionsTest-1246193084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:50:13Z,user_data=None,user_id='b53d5cada0da4be6a32eb7107cb0a727',uuid=5d09e155-7310-4998-8332-a47bf17f4f08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "address": "fa:16:3e:91:ff:b9", "network": {"id": "80bd195d-165e-4e42-a6be-467f7e03d53b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1827043037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fad8573c46f44e8b989a57719867ee9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5b3dd-1d", "ovs_interfaceid": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Converting VIF {"id": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "address": "fa:16:3e:91:ff:b9", "network": {"id": "80bd195d-165e-4e42-a6be-467f7e03d53b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1827043037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fad8573c46f44e8b989a57719867ee9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5b3dd-1d", "ovs_interfaceid": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:ff:b9,bridge_name='br-int',has_traffic_filtering=True,id=e9d5b3dd-1de1-4f7b-8199-414759c176f8,network=Network(80bd195d-165e-4e42-a6be-467f7e03d53b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5b3dd-1d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d09e155-7310-4998-8332-a47bf17f4f08 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:50:15 user nova-compute[72818]:   <uuid>5d09e155-7310-4998-8332-a47bf17f4f08</uuid>
Aug 17 21:50:15 user nova-compute[72818]:   <name>instance-00000032</name>
Aug 17 21:50:15 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:50:15 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:50:15 user nova-compute[72818]:   <metadata>
Aug 17 21:50:15 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:50:15 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:50:15 user nova-compute[72818]:       <nova:name>tempest-VolumesActionsTest-instance-1886298417</nova:name>
Aug 17 21:50:15 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:50:15</nova:creationTime>
Aug 17 21:50:15 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:50:15 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:50:15 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:50:15 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:50:15 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:50:15 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:50:15 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:50:15 user nova-compute[72818]:       <nova:owner>
Aug 17 21:50:15 user nova-compute[72818]:         <nova:user uuid="b53d5cada0da4be6a32eb7107cb0a727">tempest-VolumesActionsTest-1246193084-project-member</nova:user>
Aug 17 21:50:15 user nova-compute[72818]:         <nova:project uuid="fad8573c46f44e8b989a57719867ee9e">tempest-VolumesActionsTest-1246193084</nova:project>
Aug 17 21:50:15 user nova-compute[72818]:       </nova:owner>
Aug 17 21:50:15 user nova-compute[72818]:       <nova:root type="image" uuid="18340577-52dd-4d73-ae6b-8ba3ed9c0808"/>
Aug 17 21:50:15 user nova-compute[72818]:       <nova:ports>
Aug 17 21:50:15 user nova-compute[72818]:         <nova:port uuid="e9d5b3dd-1de1-4f7b-8199-414759c176f8">
Aug 17 21:50:15 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 21:50:15 user nova-compute[72818]:         </nova:port>
Aug 17 21:50:15 user nova-compute[72818]:       </nova:ports>
Aug 17 21:50:15 user nova-compute[72818]:     </nova:instance>
Aug 17 21:50:15 user nova-compute[72818]:   </metadata>
Aug 17 21:50:15 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:50:15 user nova-compute[72818]:     <system>
Aug 17 21:50:15 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:50:15 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:50:15 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:50:15 user nova-compute[72818]:       <entry name="serial">5d09e155-7310-4998-8332-a47bf17f4f08</entry>
Aug 17 21:50:15 user nova-compute[72818]:       <entry name="uuid">5d09e155-7310-4998-8332-a47bf17f4f08</entry>
Aug 17 21:50:15 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:50:15 user nova-compute[72818]:     </system>
Aug 17 21:50:15 user nova-compute[72818]:   </sysinfo>
Aug 17 21:50:15 user nova-compute[72818]:   <os>
Aug 17 21:50:15 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:50:15 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:50:15 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:50:15 user nova-compute[72818]:   </os>
Aug 17 21:50:15 user nova-compute[72818]:   <features>
Aug 17 21:50:15 user nova-compute[72818]:     <acpi/>
Aug 17 21:50:15 user nova-compute[72818]:     <apic/>
Aug 17 21:50:15 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:50:15 user nova-compute[72818]:   </features>
Aug 17 21:50:15 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:50:15 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:50:15 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:50:15 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:50:15 user nova-compute[72818]:   </clock>
Aug 17 21:50:15 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:50:15 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:50:15 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:50:15 user nova-compute[72818]:   </cpu>
Aug 17 21:50:15 user nova-compute[72818]:   <devices>
Aug 17 21:50:15 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:50:15 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:50:15 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk"/>
Aug 17 21:50:15 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:50:15 user nova-compute[72818]:     </disk>
Aug 17 21:50:15 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:50:15 user nova-compute[72818]:       <mac address="fa:16:3e:91:ff:b9"/>
Aug 17 21:50:15 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:50:15 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:50:15 user nova-compute[72818]:       <target dev="tape9d5b3dd-1d"/>
Aug 17 21:50:15 user nova-compute[72818]:     </interface>
Aug 17 21:50:15 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:50:15 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/console.log" append="off"/>
Aug 17 21:50:15 user nova-compute[72818]:     </serial>
Aug 17 21:50:15 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:50:15 user nova-compute[72818]:     <video>
Aug 17 21:50:15 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:50:15 user nova-compute[72818]:     </video>
Aug 17 21:50:15 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:50:15 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:50:15 user nova-compute[72818]:     </rng>
Aug 17 21:50:15 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:50:15 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:50:15 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:50:15 user nova-compute[72818]:     </memballoon>
Aug 17 21:50:15 user nova-compute[72818]:   </devices>
Aug 17 21:50:15 user nova-compute[72818]: </domain>
Aug 17 21:50:15 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:50:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1886298417',display_name='tempest-VolumesActionsTest-instance-1886298417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1886298417',id=50,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fad8573c46f44e8b989a57719867ee9e',ramdisk_id='',reservation_id='r-7fw6saq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1246193084',owner_user_name='tempest-VolumesActionsTest-1246193084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:50:13Z,user_data=None,user_id='b53d5cada0da4be6a32eb7107cb0a727',uuid=5d09e155-7310-4998-8332-a47bf17f4f08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "address": "fa:16:3e:91:ff:b9", "network": {"id": "80bd195d-165e-4e42-a6be-467f7e03d53b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1827043037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fad8573c46f44e8b989a57719867ee9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5b3dd-1d", "ovs_interfaceid": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Converting VIF {"id": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "address": "fa:16:3e:91:ff:b9", "network": {"id": "80bd195d-165e-4e42-a6be-467f7e03d53b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1827043037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fad8573c46f44e8b989a57719867ee9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5b3dd-1d", "ovs_interfaceid": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:ff:b9,bridge_name='br-int',has_traffic_filtering=True,id=e9d5b3dd-1de1-4f7b-8199-414759c176f8,network=Network(80bd195d-165e-4e42-a6be-467f7e03d53b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5b3dd-1d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG os_vif [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:ff:b9,bridge_name='br-int',has_traffic_filtering=True,id=e9d5b3dd-1de1-4f7b-8199-414759c176f8,network=Network(80bd195d-165e-4e42-a6be-467f7e03d53b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5b3dd-1d') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9d5b3dd-1d, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9d5b3dd-1d, col_values=(('external_ids', {'iface-id': 'e9d5b3dd-1de1-4f7b-8199-414759c176f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:ff:b9', 'vm-uuid': '5d09e155-7310-4998-8332-a47bf17f4f08'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:15 user nova-compute[72818]: INFO os_vif [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:ff:b9,bridge_name='br-int',has_traffic_filtering=True,id=e9d5b3dd-1de1-4f7b-8199-414759c176f8,network=Network(80bd195d-165e-4e42-a6be-467f7e03d53b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5b3dd-1d')
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] No VIF found with MAC fa:16:3e:91:ff:b9, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.network.neutron [req-7fcc51e8-a808-4698-bf9f-9bf614482749 req-343c5441-43f0-461a-8fc3-f327c4c32811 service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Updated VIF entry in instance network info cache for port e9d5b3dd-1de1-4f7b-8199-414759c176f8. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG nova.network.neutron [req-7fcc51e8-a808-4698-bf9f-9bf614482749 req-343c5441-43f0-461a-8fc3-f327c4c32811 service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Updating instance_info_cache with network_info: [{"id": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "address": "fa:16:3e:91:ff:b9", "network": {"id": "80bd195d-165e-4e42-a6be-467f7e03d53b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1827043037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fad8573c46f44e8b989a57719867ee9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5b3dd-1d", "ovs_interfaceid": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:50:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7fcc51e8-a808-4698-bf9f-9bf614482749 req-343c5441-43f0-461a-8fc3-f327c4c32811 service nova] Releasing lock "refresh_cache-5d09e155-7310-4998-8332-a47bf17f4f08" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:50:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-b0fcc42a-9f3d-48bc-a788-42651005054b req-d7b2bc95-ff76-4b24-bf0c-a1bdba0f100d service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Received event network-vif-plugged-e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:50:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b0fcc42a-9f3d-48bc-a788-42651005054b req-d7b2bc95-ff76-4b24-bf0c-a1bdba0f100d service nova] Acquiring lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b0fcc42a-9f3d-48bc-a788-42651005054b req-d7b2bc95-ff76-4b24-bf0c-a1bdba0f100d service nova] Lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b0fcc42a-9f3d-48bc-a788-42651005054b req-d7b2bc95-ff76-4b24-bf0c-a1bdba0f100d service nova] Lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-b0fcc42a-9f3d-48bc-a788-42651005054b req-d7b2bc95-ff76-4b24-bf0c-a1bdba0f100d service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] No waiting events found dispatching network-vif-plugged-e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:50:16 user nova-compute[72818]: WARNING nova.compute.manager [req-b0fcc42a-9f3d-48bc-a788-42651005054b req-d7b2bc95-ff76-4b24-bf0c-a1bdba0f100d service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Received unexpected event network-vif-plugged-e9d5b3dd-1de1-4f7b-8199-414759c176f8 for instance with vm_state building and task_state spawning.
Aug 17 21:50:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "3173752d-5125-492c-9358-788c2dbb7ba5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "3173752d-5125-492c-9358-788c2dbb7ba5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:17 user nova-compute[72818]: DEBUG nova.objects.instance [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'flavor' on Instance uuid 3173752d-5125-492c-9358-788c2dbb7ba5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:50:17 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "3173752d-5125-492c-9358-788c2dbb7ba5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "3173752d-5125-492c-9358-788c2dbb7ba5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "3173752d-5125-492c-9358-788c2dbb7ba5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:18 user nova-compute[72818]: INFO nova.compute.manager [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Attaching volume 119390ad-bf5d-4fc5-ba61-fe4b2e15f577 to /dev/vdb
Aug 17 21:50:18 user nova-compute[72818]: DEBUG os_brick.utils [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[54984ace-60dd-4966-b117-4ebbe3c0d9d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b996f94-d40b-445b-88bc-7a55d2252c09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98d39b8-454d-44d9-8702-11a7dd2ac541]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9448554-4444-46d1-9cf6-21c8bff87b60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:50:18 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec1ce3b-74e7-4d76-a2e3-bc6d36fe0b3c]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG os_brick.utils [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Updating existing volume attachment record: b8fa271b-7f72-49a4-95a4-f920d7ebf635 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692309018.7633593, 5d09e155-7310-4998-8332-a47bf17f4f08 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:50:18 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] VM Resumed (Lifecycle Event)
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:50:18 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Instance spawned successfully.
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:50:18 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692309018.7652702, 5d09e155-7310-4998-8332-a47bf17f4f08 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:50:18 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] VM Started (Lifecycle Event)
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:50:18 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:50:18 user nova-compute[72818]: INFO nova.compute.manager [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Took 5.59 seconds to spawn the instance on the hypervisor.
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.compute.manager [req-e285f36f-f80c-4b36-a568-afb4d03e53d4 req-5d6382d8-f57d-4c5d-8e0a-e8cab334e5cd service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Received event network-vif-plugged-e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e285f36f-f80c-4b36-a568-afb4d03e53d4 req-5d6382d8-f57d-4c5d-8e0a-e8cab334e5cd service nova] Acquiring lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e285f36f-f80c-4b36-a568-afb4d03e53d4 req-5d6382d8-f57d-4c5d-8e0a-e8cab334e5cd service nova] Lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e285f36f-f80c-4b36-a568-afb4d03e53d4 req-5d6382d8-f57d-4c5d-8e0a-e8cab334e5cd service nova] Lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:18 user nova-compute[72818]: DEBUG nova.compute.manager [req-e285f36f-f80c-4b36-a568-afb4d03e53d4 req-5d6382d8-f57d-4c5d-8e0a-e8cab334e5cd service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] No waiting events found dispatching network-vif-plugged-e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:50:18 user nova-compute[72818]: WARNING nova.compute.manager [req-e285f36f-f80c-4b36-a568-afb4d03e53d4 req-5d6382d8-f57d-4c5d-8e0a-e8cab334e5cd service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Received unexpected event network-vif-plugged-e9d5b3dd-1de1-4f7b-8199-414759c176f8 for instance with vm_state building and task_state spawning.
Aug 17 21:50:18 user nova-compute[72818]: INFO nova.compute.manager [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Took 6.16 seconds to build instance.
Aug 17 21:50:18 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ebb3e3c2-dba6-4668-92f5-460204573c2a tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "5d09e155-7310-4998-8332-a47bf17f4f08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.272s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:19 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:50:19 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:50:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:22 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:50:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:50:22 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:50:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:50:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:50:22 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:50:22 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid 3173752d-5125-492c-9358-788c2dbb7ba5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:50:23 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Updating instance_info_cache with network_info: [{"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:50:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-3173752d-5125-492c-9358-788c2dbb7ba5" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:50:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:50:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:25 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:50:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:25 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:25 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:50:25 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:27 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:50:27 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:50:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8698MB free_disk=25.26403045654297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:50:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 3173752d-5125-492c-9358-788c2dbb7ba5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:50:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 5d09e155-7310-4998-8332-a47bf17f4f08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:50:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:50:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:50:27 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:50:27 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:50:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:50:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPIBXWZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:50:28 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:50:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:50:28 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:50:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:50:28 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:50:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[af54dfa3-faaf-4749-ba3c-89c6d3b04381]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:50:28 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7bb1bb-18af-42b1-b22d-710c4622e79f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577] added
Aug 17 21:50:28 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[939658ac-5cfe-477d-9b45-eff1f6af925b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:50:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d15e0d-923d-4fa8-a4e8-c81f212a5fc1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPIBXWZq {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPIBXWZq" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb447438-4c90-4831-a228-0acd0b1d304d]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gPIBXWZq'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f73478-4d70-4b41-bc0c-180ac5178143]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[50375cfd-93ce-44c6-83eb-e69b4de3b733]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:50:29 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:50:29 user nova-compute[72818]:  {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:50:29 user nova-compute[72818]: WARNING os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 21:50:29 user nova-compute[72818]: 
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf33fe88-f428-467b-b243-7a79c14e19d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577, portal: 172.16.0.220,3260]
Aug 17 21:50:29 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577, portal: 172.16.0.220,3260] successful.
Aug 17 21:50:29 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cca967e-2947-4304-826e-cad4aac1cc2a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4aa22a-a91f-417f-8545-c2a40fa96be3]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 (non-flash)
Aug 17 21:50:29 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 (non-flash)
Aug 17 21:50:29 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b9fb54-f5d2-4982-95ed-3c91c5d6dd18]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPIBXWZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23435346263666161', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435346263666161', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG nova.objects.instance [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'flavor' on Instance uuid 3173752d-5125-492c-9358-788c2dbb7ba5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:50:30 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:50:30 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:50:30 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:50:30 user nova-compute[72818]:   <serial>119390ad-bf5d-4fc5-ba61-fe4b2e15f577</serial>
Aug 17 21:50:30 user nova-compute[72818]: </disk>
Aug 17 21:50:30 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] No VIF found with MAC fa:16:3e:38:4b:72, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:50:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-39fdd331-ab77-4096-8223-60ad037fa3e4 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "3173752d-5125-492c-9358-788c2dbb7ba5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.637s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "3173752d-5125-492c-9358-788c2dbb7ba5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "3173752d-5125-492c-9358-788c2dbb7ba5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:31 user nova-compute[72818]: INFO nova.compute.manager [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Detaching volume 119390ad-bf5d-4fc5-ba61-fe4b2e15f577
Aug 17 21:50:31 user nova-compute[72818]: INFO nova.virt.block_device [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Attempting to driver detach volume 119390ad-bf5d-4fc5-ba61-fe4b2e15f577 from mountpoint /dev/vdb
Aug 17 21:50:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Attempting to detach device vdb from instance 3173752d-5125-492c-9358-788c2dbb7ba5 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:50:31 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:50:31 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:50:31 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:50:31 user nova-compute[72818]:   <serial>119390ad-bf5d-4fc5-ba61-fe4b2e15f577</serial>
Aug 17 21:50:31 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:50:31 user nova-compute[72818]: </disk>
Aug 17 21:50:31 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:50:31 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully detached device vdb from instance 3173752d-5125-492c-9358-788c2dbb7ba5 from the persistent domain config.
Aug 17 21:50:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3173752d-5125-492c-9358-788c2dbb7ba5 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 21:50:31 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:50:31 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:50:31 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:50:31 user nova-compute[72818]:   <serial>119390ad-bf5d-4fc5-ba61-fe4b2e15f577</serial>
Aug 17 21:50:31 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 21:50:31 user nova-compute[72818]: </disk>
Aug 17 21:50:31 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692309031.9139175, 3173752d-5125-492c-9358-788c2dbb7ba5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3173752d-5125-492c-9358-788c2dbb7ba5 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 21:50:31 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully detached device vdb from instance 3173752d-5125-492c-9358-788c2dbb7ba5 from the live domain config.
Aug 17 21:50:31 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPIBXWZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:50:31 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:50:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc42721-0423-4a42-afe5-0c302424091b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc3137f-ea7b-4fdb-8023-fa48d6c9dd1a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 (non-flash)
Aug 17 21:50:31 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 (non-flash)
Aug 17 21:50:31 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04faa0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3397d8-3367-4439-b948-80dd508de1e8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb50957-499c-4cd7-a07c-6df9d0f932c0]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d25fea0-dea1-4a9e-b9fc-5c92157df8d8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[244a992e-d3df-4668-a3e8-8d5789838cd6]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ed85a8-d095-40e3-a5c3-01a4ba20c314]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[362a90a2-c432-4987-95e0-d90c7534f09b]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577, portal: 172.16.0.220,3260]
Aug 17 21:50:32 user nova-compute[72818]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577, portal: 172.16.0.220,3260] successful.
Aug 17 21:50:32 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119390ad-bf5d-4fc5-ba61-fe4b2e15f577 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e118e-4f11-4519-9e21-2912a959bbc8]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] <== disconnect_volume: return (253ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:50:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:33 user nova-compute[72818]: DEBUG nova.objects.instance [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'flavor' on Instance uuid 3173752d-5125-492c-9358-788c2dbb7ba5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:50:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3d88cd56-da99-4b82-a4f2-2979b9325a23 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "3173752d-5125-492c-9358-788c2dbb7ba5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.710s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Verify base images {{(pid=72818) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Image id 18340577-52dd-4d73-ae6b-8ba3ed9c0808 yields fingerprint f01fe075652c036b83af5d179c60f228b745dd35 {{(pid=72818) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 21:50:41 user nova-compute[72818]: INFO nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] image 18340577-52dd-4d73-ae6b-8ba3ed9c0808 at (/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35): checking
Aug 17 21:50:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] image 18340577-52dd-4d73-ae6b-8ba3ed9c0808 at (/opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35): image is in use {{(pid=72818) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72818) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] 3173752d-5125-492c-9358-788c2dbb7ba5 is a valid instance name {{(pid=72818) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] 3173752d-5125-492c-9358-788c2dbb7ba5 has a disk file {{(pid=72818) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 21:50:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 3173752d-5125-492c-9358-788c2dbb7ba5 is backed by f01fe075652c036b83af5d179c60f228b745dd35 {{(pid=72818) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 21:50:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] 5d09e155-7310-4998-8332-a47bf17f4f08 is a valid instance name {{(pid=72818) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 21:50:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] 5d09e155-7310-4998-8332-a47bf17f4f08 has a disk file {{(pid=72818) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 21:50:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:50:42 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:50:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 5d09e155-7310-4998-8332-a47bf17f4f08 is backed by f01fe075652c036b83af5d179c60f228b745dd35 {{(pid=72818) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 21:50:42 user nova-compute[72818]: WARNING nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Unknown base file: /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4
Aug 17 21:50:42 user nova-compute[72818]: WARNING nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Unknown base file: /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf
Aug 17 21:50:42 user nova-compute[72818]: WARNING nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Unknown base file: /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd
Aug 17 21:50:42 user nova-compute[72818]: WARNING nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Unknown base file: /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108
Aug 17 21:50:42 user nova-compute[72818]: WARNING nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Unknown base file: /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd
Aug 17 21:50:42 user nova-compute[72818]: WARNING nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Unknown base file: /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb
Aug 17 21:50:42 user nova-compute[72818]: WARNING nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Unknown base file: /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3
Aug 17 21:50:42 user nova-compute[72818]: INFO nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Active base files: /opt/stack/data/nova/instances/_base/f01fe075652c036b83af5d179c60f228b745dd35
Aug 17 21:50:42 user nova-compute[72818]: INFO nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Removable base files: /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4 /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108 /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3
Aug 17 21:50:42 user nova-compute[72818]: INFO nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e8ac6b3c85815823af565cc8f13c1f02c02d5dc4
Aug 17 21:50:42 user nova-compute[72818]: INFO nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/255aba1c3e2285638a5827135c6108ad591980bf
Aug 17 21:50:42 user nova-compute[72818]: INFO nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8c91eb155e1478580b8c0bb9e22bb5f250d830fd
Aug 17 21:50:42 user nova-compute[72818]: INFO nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d842fc4e3e893d16e93683f9572a74120b2ba108
Aug 17 21:50:42 user nova-compute[72818]: INFO nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1fd8a3249293151f726f4921454c7fdbc67217bd
Aug 17 21:50:42 user nova-compute[72818]: INFO nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4226b1acd3b1690228c220f7a06e0c065a3a4fdb
Aug 17 21:50:42 user nova-compute[72818]: INFO nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b5f5c5b65f33535beb9e4b1081622a07def4bdb3
Aug 17 21:50:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Verification complete {{(pid=72818) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 17 21:50:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Verify swap images {{(pid=72818) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 17 21:50:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.imagecache [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Verify ephemeral images {{(pid=72818) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 17 21:50:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:50:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:51:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:51:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:51:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:16 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:16 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:51:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:20 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:20 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "3173752d-5125-492c-9358-788c2dbb7ba5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:51:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "3173752d-5125-492c-9358-788c2dbb7ba5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:51:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:51:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:51:21 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:51:21 user nova-compute[72818]: INFO nova.compute.manager [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Terminating instance
Aug 17 21:51:21 user nova-compute[72818]: DEBUG nova.compute.manager [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:51:21 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-da4de41b-08a1-4090-892b-0ddd80477695 req-99845ca0-e850-413b-8bf9-954d7a6263da service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Received event network-vif-unplugged-83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-da4de41b-08a1-4090-892b-0ddd80477695 req-99845ca0-e850-413b-8bf9-954d7a6263da service nova] Acquiring lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-da4de41b-08a1-4090-892b-0ddd80477695 req-99845ca0-e850-413b-8bf9-954d7a6263da service nova] Lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-da4de41b-08a1-4090-892b-0ddd80477695 req-99845ca0-e850-413b-8bf9-954d7a6263da service nova] Lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-da4de41b-08a1-4090-892b-0ddd80477695 req-99845ca0-e850-413b-8bf9-954d7a6263da service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] No waiting events found dispatching network-vif-unplugged-83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG nova.compute.manager [req-da4de41b-08a1-4090-892b-0ddd80477695 req-99845ca0-e850-413b-8bf9-954d7a6263da service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Received event network-vif-unplugged-83d35f92-11a5-46e8-9d1b-33a8328f45ac for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:22 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Instance destroyed successfully.
Aug 17 21:51:22 user nova-compute[72818]: DEBUG nova.objects.instance [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lazy-loading 'resources' on Instance uuid 3173752d-5125-492c-9358-788c2dbb7ba5 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-159121961',display_name='tempest-AttachVolumeNegativeTest-server-159121961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-159121961',id=49,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNepYhi0DdkCeHgDr1imn8BINAXyTO28/vHVYsuiqGSP/ltZX7zfhcitZbqXDk63fmxrKmuydxD7w7GZH5JTCwtCjKvgQVc46Ok4iVqAhKW5BwxLqQZiOHQ2CGeeZXH7XA==',key_name='tempest-keypair-1367773031',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:48:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ffd845455a84fbf9e1517ffe2af001c',ramdisk_id='',reservation_id='r-adovi85c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2048664550',owner_user_name='tempest-AttachVolumeNegativeTest-2048664550-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d025fb1e3974f5d91a7086343bbe5e1',uuid=3173752d-5125-492c-9358-788c2dbb7ba5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converting VIF {"id": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "address": "fa:16:3e:38:4b:72", "network": {"id": "5674fffc-ec0f-455a-9c0d-979308b2280d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-987316807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ffd845455a84fbf9e1517ffe2af001c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83d35f92-11", "ovs_interfaceid": "83d35f92-11a5-46e8-9d1b-33a8328f45ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=83d35f92-11a5-46e8-9d1b-33a8328f45ac,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d35f92-11') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG os_vif [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=83d35f92-11a5-46e8-9d1b-33a8328f45ac,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d35f92-11') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83d35f92-11, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:22 user nova-compute[72818]: INFO os_vif [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=83d35f92-11a5-46e8-9d1b-33a8328f45ac,network=Network(5674fffc-ec0f-455a-9c0d-979308b2280d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83d35f92-11')
Aug 17 21:51:22 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Deleting instance files /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5_del
Aug 17 21:51:22 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Deletion of /opt/stack/data/nova/instances/3173752d-5125-492c-9358-788c2dbb7ba5_del complete
Aug 17 21:51:22 user nova-compute[72818]: INFO nova.compute.manager [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 21:51:22 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:51:22 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:51:23 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Took 1.00 seconds to deallocate network for instance.
Aug 17 21:51:23 user nova-compute[72818]: DEBUG nova.compute.manager [req-639f45d6-0020-483d-8b69-be60663a4a53 req-00a7ed55-afc5-4d1c-ae9a-4d6141e246a2 service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Received event network-vif-deleted-83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Refreshing inventories for resource provider d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Updating ProviderTree inventory for provider d156e3af-684d-47e1-a951-585f9c95fa46 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-5d09e155-7310-4998-8332-a47bf17f4f08" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-5d09e155-7310-4998-8332-a47bf17f4f08" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Refreshing aggregate associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, aggregates: None {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 21:51:23 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Refreshing trait associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 21:51:24 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:51:24 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:51:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:51:24 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Deleted allocations for instance 3173752d-5125-492c-9358-788c2dbb7ba5
Aug 17 21:51:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-8b7d55a8-2f44-42e4-b1fc-f0812c8d1a51 req-8bda5085-5ad1-4a6f-8efb-16a98028f2db service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Received event network-vif-plugged-83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:51:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8b7d55a8-2f44-42e4-b1fc-f0812c8d1a51 req-8bda5085-5ad1-4a6f-8efb-16a98028f2db service nova] Acquiring lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:51:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8b7d55a8-2f44-42e4-b1fc-f0812c8d1a51 req-8bda5085-5ad1-4a6f-8efb-16a98028f2db service nova] Lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:51:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-8b7d55a8-2f44-42e4-b1fc-f0812c8d1a51 req-8bda5085-5ad1-4a6f-8efb-16a98028f2db service nova] Lock "3173752d-5125-492c-9358-788c2dbb7ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:51:24 user nova-compute[72818]: DEBUG nova.compute.manager [req-8b7d55a8-2f44-42e4-b1fc-f0812c8d1a51 req-8bda5085-5ad1-4a6f-8efb-16a98028f2db service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] No waiting events found dispatching network-vif-plugged-83d35f92-11a5-46e8-9d1b-33a8328f45ac {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:51:24 user nova-compute[72818]: WARNING nova.compute.manager [req-8b7d55a8-2f44-42e4-b1fc-f0812c8d1a51 req-8bda5085-5ad1-4a6f-8efb-16a98028f2db service nova] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Received unexpected event network-vif-plugged-83d35f92-11a5-46e8-9d1b-33a8328f45ac for instance with vm_state deleted and task_state None.
Aug 17 21:51:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-185194c5-00d5-40fe-a142-3fd1c4a1d9a3 tempest-AttachVolumeNegativeTest-2048664550 tempest-AttachVolumeNegativeTest-2048664550-project-member] Lock "3173752d-5125-492c-9358-788c2dbb7ba5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.475s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:51:24 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Updating instance_info_cache with network_info: [{"id": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "address": "fa:16:3e:91:ff:b9", "network": {"id": "80bd195d-165e-4e42-a6be-467f7e03d53b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1827043037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fad8573c46f44e8b989a57719867ee9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5b3dd-1d", "ovs_interfaceid": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:51:24 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-5d09e155-7310-4998-8332-a47bf17f4f08" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:51:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:51:24 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72818) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 21:51:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:51:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:51:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:51:26 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:51:26 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:27 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:51:27 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:51:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8731MB free_disk=25.263141632080078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance 5d09e155-7310-4998-8332-a47bf17f4f08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:51:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:51:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 21:51:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] There are 0 instances to clean {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 21:51:29 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:51:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:51:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:37 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692309082.5142612, 3173752d-5125-492c-9358-788c2dbb7ba5 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:51:37 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] VM Stopped (Lifecycle Event)
Aug 17 21:51:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-334529e3-4677-47e9-a59c-7927cb1471a1 None None] [instance: 3173752d-5125-492c-9358-788c2dbb7ba5] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:51:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:39 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:51:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:51:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:51:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:51:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:51:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:51:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:52:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:52:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Acquiring lock "5d09e155-7310-4998-8332-a47bf17f4f08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "5d09e155-7310-4998-8332-a47bf17f4f08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Acquiring lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:52:14 user nova-compute[72818]: INFO nova.compute.manager [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Terminating instance
Aug 17 21:52:14 user nova-compute[72818]: DEBUG nova.compute.manager [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-ec528afe-a7ca-453d-8bc5-6a41d97072aa req-108a4cb2-3697-432b-bd50-9d7a81ff7eb9 service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Received event network-vif-unplugged-e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ec528afe-a7ca-453d-8bc5-6a41d97072aa req-108a4cb2-3697-432b-bd50-9d7a81ff7eb9 service nova] Acquiring lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ec528afe-a7ca-453d-8bc5-6a41d97072aa req-108a4cb2-3697-432b-bd50-9d7a81ff7eb9 service nova] Lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-ec528afe-a7ca-453d-8bc5-6a41d97072aa req-108a4cb2-3697-432b-bd50-9d7a81ff7eb9 service nova] Lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-ec528afe-a7ca-453d-8bc5-6a41d97072aa req-108a4cb2-3697-432b-bd50-9d7a81ff7eb9 service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] No waiting events found dispatching network-vif-unplugged-e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:52:14 user nova-compute[72818]: DEBUG nova.compute.manager [req-ec528afe-a7ca-453d-8bc5-6a41d97072aa req-108a4cb2-3697-432b-bd50-9d7a81ff7eb9 service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Received event network-vif-unplugged-e9d5b3dd-1de1-4f7b-8199-414759c176f8 for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 21:52:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Instance destroyed successfully.
Aug 17 21:52:15 user nova-compute[72818]: DEBUG nova.objects.instance [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lazy-loading 'resources' on Instance uuid 5d09e155-7310-4998-8332-a47bf17f4f08 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:50:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1886298417',display_name='tempest-VolumesActionsTest-instance-1886298417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1886298417',id=50,image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:50:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fad8573c46f44e8b989a57719867ee9e',ramdisk_id='',reservation_id='r-7fw6saq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='18340577-52dd-4d73-ae6b-8ba3ed9c0808',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1246193084',owner_user_name='tempest-VolumesActionsTest-1246193084-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:50:19Z,user_data=None,user_id='b53d5cada0da4be6a32eb7107cb0a727',uuid=5d09e155-7310-4998-8332-a47bf17f4f08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "address": "fa:16:3e:91:ff:b9", "network": {"id": "80bd195d-165e-4e42-a6be-467f7e03d53b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1827043037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fad8573c46f44e8b989a57719867ee9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5b3dd-1d", "ovs_interfaceid": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Converting VIF {"id": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "address": "fa:16:3e:91:ff:b9", "network": {"id": "80bd195d-165e-4e42-a6be-467f7e03d53b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1827043037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fad8573c46f44e8b989a57719867ee9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5b3dd-1d", "ovs_interfaceid": "e9d5b3dd-1de1-4f7b-8199-414759c176f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:ff:b9,bridge_name='br-int',has_traffic_filtering=True,id=e9d5b3dd-1de1-4f7b-8199-414759c176f8,network=Network(80bd195d-165e-4e42-a6be-467f7e03d53b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5b3dd-1d') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG os_vif [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:ff:b9,bridge_name='br-int',has_traffic_filtering=True,id=e9d5b3dd-1de1-4f7b-8199-414759c176f8,network=Network(80bd195d-165e-4e42-a6be-467f7e03d53b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5b3dd-1d') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9d5b3dd-1d, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:52:15 user nova-compute[72818]: INFO os_vif [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:ff:b9,bridge_name='br-int',has_traffic_filtering=True,id=e9d5b3dd-1de1-4f7b-8199-414759c176f8,network=Network(80bd195d-165e-4e42-a6be-467f7e03d53b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5b3dd-1d')
Aug 17 21:52:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Deleting instance files /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08_del
Aug 17 21:52:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Deletion of /opt/stack/data/nova/instances/5d09e155-7310-4998-8332-a47bf17f4f08_del complete
Aug 17 21:52:15 user nova-compute[72818]: INFO nova.compute.manager [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 21:52:15 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:52:15 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Took 0.49 seconds to deallocate network for instance.
Aug 17 21:52:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-cca21750-9ac1-4875-8b74-05fb5ca72cc3 req-9e89c5ae-3d22-400c-896a-21383d8f5635 service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Received event network-vif-deleted-e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:52:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:52:15 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Deleted allocations for instance 5d09e155-7310-4998-8332-a47bf17f4f08
Aug 17 21:52:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-b8a2d504-7c1b-4dfe-ac8f-ddf042842ef5 tempest-VolumesActionsTest-1246193084 tempest-VolumesActionsTest-1246193084-project-member] Lock "5d09e155-7310-4998-8332-a47bf17f4f08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.700s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:52:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-398051dd-3622-4660-b390-4928a47bcb45 req-17e939c0-d53e-4f4f-a417-2012304d1e7d service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Received event network-vif-plugged-e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:52:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-398051dd-3622-4660-b390-4928a47bcb45 req-17e939c0-d53e-4f4f-a417-2012304d1e7d service nova] Acquiring lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:52:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-398051dd-3622-4660-b390-4928a47bcb45 req-17e939c0-d53e-4f4f-a417-2012304d1e7d service nova] Lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:52:16 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-398051dd-3622-4660-b390-4928a47bcb45 req-17e939c0-d53e-4f4f-a417-2012304d1e7d service nova] Lock "5d09e155-7310-4998-8332-a47bf17f4f08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:52:16 user nova-compute[72818]: DEBUG nova.compute.manager [req-398051dd-3622-4660-b390-4928a47bcb45 req-17e939c0-d53e-4f4f-a417-2012304d1e7d service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] No waiting events found dispatching network-vif-plugged-e9d5b3dd-1de1-4f7b-8199-414759c176f8 {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:52:16 user nova-compute[72818]: WARNING nova.compute.manager [req-398051dd-3622-4660-b390-4928a47bcb45 req-17e939c0-d53e-4f4f-a417-2012304d1e7d service nova] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Received unexpected event network-vif-plugged-e9d5b3dd-1de1-4f7b-8199-414759c176f8 for instance with vm_state deleted and task_state None.
Aug 17 21:52:17 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:52:17 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:52:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:22 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:52:22 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:52:23 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:52:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:52:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:52:23 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 21:52:23 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:52:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:52:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:52:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:52:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:52:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:52:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:52:28 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:52:28 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:52:28 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=25.289817810058594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:52:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:52:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:52:28 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:52:28 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:52:28 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:52:28 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:52:28 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:52:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:52:30 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692309134.9980977, 5d09e155-7310-4998-8332-a47bf17f4f08 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:52:30 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] VM Stopped (Lifecycle Event)
Aug 17 21:52:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-c0ea5735-3abf-4ed8-b6fd-694eeee59b57 None None] [instance: 5d09e155-7310-4998-8332-a47bf17f4f08] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:52:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:52:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:52:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:52:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:52:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:52:30 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:52:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:52:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:52:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:52:44 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:52:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:52:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:52:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:53:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:53:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:53:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:53:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:53:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:53:17 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:53:19 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:53:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:53:23 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:53:24 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:53:24 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:53:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:53:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:53:24 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 21:53:24 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:53:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:53:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:53:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:53:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:53:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:53:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:53:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:53:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:53:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:53:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:53:27 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:53:28 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:53:28 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:53:28 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8887MB free_disk=25.287017822265625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:53:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:53:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:53:28 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:53:28 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:53:28 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:53:28 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:53:28 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:53:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:53:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:53:32 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:53:32 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:53:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:53:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:53:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:53:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:53:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:53:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:53:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:03 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:54:19 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:54:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:54:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:54:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:54:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:54:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:54:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:21 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:54:23 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:54:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:25 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:54:25 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:54:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:54:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:54:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 21:54:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:54:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:54:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:54:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:54:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:54:28 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:54:29 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:54:29 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:54:29 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=25.276126861572266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:54:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:54:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:54:29 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:54:29 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:54:29 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:54:29 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:54:29 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:54:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:54:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:54:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:54:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:54:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:54:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:32 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:54:32 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:54:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:54:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:54:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:54:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:55:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:55:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:55:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:55:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:55:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:55:21 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:55:23 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:55:24 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:55:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:55:25 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:55:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:55:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:55:25 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 21:55:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:55:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:55:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:55:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:55:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:55:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:55:28 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:55:29 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:55:29 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:55:29 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8890MB free_disk=25.274063110351562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:55:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:55:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:55:29 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:55:29 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:55:29 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:55:29 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:55:29 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:55:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:55:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:55:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:55:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:55:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:55:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:55:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:55:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:55:46 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:55:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:55:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:55:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 21:55:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:55:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 21:55:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:55:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:55:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:55:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:55:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:55:58 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:56:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:56:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 21:56:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:56:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:56:08 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 21:56:08 user nova-compute[72818]: INFO nova.compute.claims [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Claim successful on node user
Aug 17 21:56:08 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:56:08 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:56:08 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:56:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 21:56:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 21:56:08 user nova-compute[72818]: DEBUG nova.network.neutron [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 21:56:08 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 21:56:08 user nova-compute[72818]: DEBUG nova.compute.manager [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 21:56:09 user nova-compute[72818]: DEBUG nova.compute.manager [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 21:56:09 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 21:56:09 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Creating image(s)
Aug 17 21:56:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "/opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:56:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "/opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:56:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "/opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:56:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "8330be8c1a235cc3178e6699f8f242493f0cbb03" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:56:09 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "8330be8c1a235cc3178e6699f8f242493f0cbb03" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:56:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03.part --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:56:09 user nova-compute[72818]: DEBUG nova.policy [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d34610b992e405795f5a4d71fcdee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29887fb0e7004a0e8ae9266e24b83590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 21:56:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03.part --force-share --output=json" returned: 0 in 0.202s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:56:09 user nova-compute[72818]: DEBUG nova.virt.images [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] f6fb3ce1-35fc-4d33-9a24-6d75177877b7 was qcow2, converting to raw {{(pid=72818) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 21:56:09 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 21:56:09 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03.part /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03.converted {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03.part /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03.converted" returned: 0 in 0.407s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03.converted --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG nova.network.neutron [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Successfully created port: 43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "8330be8c1a235cc3178e6699f8f242493f0cbb03" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.341s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03 --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "8330be8c1a235cc3178e6699f8f242493f0cbb03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "8330be8c1a235cc3178e6699f8f242493f0cbb03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03 --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03,backing_fmt=raw /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03,backing_fmt=raw /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk 1073741824" returned: 0 in 0.053s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "8330be8c1a235cc3178e6699f8f242493f0cbb03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:56:10 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03 --force-share --output=json" returned: 0 in 0.186s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Cannot resize image /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.objects.instance [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'migration_context' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.network.neutron [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Successfully updated port: 43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Ensure instance console log exists: /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.network.neutron [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.network.neutron [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-7d06d1be-f6cc-49be-b6c6-e9ef0045190b req-5605835c-3229-43ed-8b6e-e05ef88b32e4 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-changed-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.compute.manager [req-7d06d1be-f6cc-49be-b6c6-e9ef0045190b req-5605835c-3229-43ed-8b6e-e05ef88b32e4 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Refreshing instance network info cache due to event network-changed-43c02962-b54c-4d84-bfd0-2150523456ae. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7d06d1be-f6cc-49be-b6c6-e9ef0045190b req-5605835c-3229-43ed-8b6e-e05ef88b32e4 service nova] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.network.neutron [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.compute.manager [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Instance network_info: |[{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7d06d1be-f6cc-49be-b6c6-e9ef0045190b req-5605835c-3229-43ed-8b6e-e05ef88b32e4 service nova] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.network.neutron [req-7d06d1be-f6cc-49be-b6c6-e9ef0045190b req-5605835c-3229-43ed-8b6e-e05ef88b32e4 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Refreshing network info cache for port 43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Start _get_guest_xml network_info=[{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:56:05Z,direct_url=<?>,disk_format='qcow2',id=f6fb3ce1-35fc-4d33-9a24-6d75177877b7,min_disk=0,min_ram=0,name='tempest-scenario-img--1326079556',owner='29887fb0e7004a0e8ae9266e24b83590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:56:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': 'f6fb3ce1-35fc-4d33-9a24-6d75177877b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:56:11 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:56:11 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T21:56:05Z,direct_url=<?>,disk_format='qcow2',id=f6fb3ce1-35fc-4d33-9a24-6d75177877b7,min_disk=0,min_ram=0,name='tempest-scenario-img--1326079556',owner='29887fb0e7004a0e8ae9266e24b83590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T21:56:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-990799106',display_name='tempest-TestMinimumBasicScenario-server-990799106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-990799106',id=51,image_ref='f6fb3ce1-35fc-4d33-9a24-6d75177877b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6oNeNsuNUnFWJDxDz+9IRi1YC0RHi3RFoe4yOiqacct+p2P6CccvsrguXhqZc/kY+mEFByPZi/NhesYDfId0aVrCWyoECLLcP0tLAYicYnneMkt1e9AwDZhf51Fd/5Lg==',key_name='tempest-TestMinimumBasicScenario-904693589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29887fb0e7004a0e8ae9266e24b83590',ramdisk_id='',reservation_id='r-qp973neb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f6fb3ce1-35fc-4d33-9a24-6d75177877b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-433210411',owner_user_name='tempest-TestMinimumBasicScenario-433210411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:56:09Z,user_data=None,user_id='2d34610b992e405795f5a4d71fcdee44',uuid=dff19f99-0e58-4d0a-8cd4-6adf2142da7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converting VIF {"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.objects.instance [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'pci_devices' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:56:11 user nova-compute[72818]:   <uuid>dff19f99-0e58-4d0a-8cd4-6adf2142da7c</uuid>
Aug 17 21:56:11 user nova-compute[72818]:   <name>instance-00000033</name>
Aug 17 21:56:11 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:56:11 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:56:11 user nova-compute[72818]:   <metadata>
Aug 17 21:56:11 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:56:11 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:56:11 user nova-compute[72818]:       <nova:name>tempest-TestMinimumBasicScenario-server-990799106</nova:name>
Aug 17 21:56:11 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:56:11</nova:creationTime>
Aug 17 21:56:11 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:56:11 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:56:11 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:56:11 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:56:11 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:56:11 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:56:11 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:56:11 user nova-compute[72818]:       <nova:owner>
Aug 17 21:56:11 user nova-compute[72818]:         <nova:user uuid="2d34610b992e405795f5a4d71fcdee44">tempest-TestMinimumBasicScenario-433210411-project-member</nova:user>
Aug 17 21:56:11 user nova-compute[72818]:         <nova:project uuid="29887fb0e7004a0e8ae9266e24b83590">tempest-TestMinimumBasicScenario-433210411</nova:project>
Aug 17 21:56:11 user nova-compute[72818]:       </nova:owner>
Aug 17 21:56:11 user nova-compute[72818]:       <nova:root type="image" uuid="f6fb3ce1-35fc-4d33-9a24-6d75177877b7"/>
Aug 17 21:56:11 user nova-compute[72818]:       <nova:ports>
Aug 17 21:56:11 user nova-compute[72818]:         <nova:port uuid="43c02962-b54c-4d84-bfd0-2150523456ae">
Aug 17 21:56:11 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 21:56:11 user nova-compute[72818]:         </nova:port>
Aug 17 21:56:11 user nova-compute[72818]:       </nova:ports>
Aug 17 21:56:11 user nova-compute[72818]:     </nova:instance>
Aug 17 21:56:11 user nova-compute[72818]:   </metadata>
Aug 17 21:56:11 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:56:11 user nova-compute[72818]:     <system>
Aug 17 21:56:11 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:56:11 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:56:11 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:56:11 user nova-compute[72818]:       <entry name="serial">dff19f99-0e58-4d0a-8cd4-6adf2142da7c</entry>
Aug 17 21:56:11 user nova-compute[72818]:       <entry name="uuid">dff19f99-0e58-4d0a-8cd4-6adf2142da7c</entry>
Aug 17 21:56:11 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:56:11 user nova-compute[72818]:     </system>
Aug 17 21:56:11 user nova-compute[72818]:   </sysinfo>
Aug 17 21:56:11 user nova-compute[72818]:   <os>
Aug 17 21:56:11 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:56:11 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:56:11 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:56:11 user nova-compute[72818]:   </os>
Aug 17 21:56:11 user nova-compute[72818]:   <features>
Aug 17 21:56:11 user nova-compute[72818]:     <acpi/>
Aug 17 21:56:11 user nova-compute[72818]:     <apic/>
Aug 17 21:56:11 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:56:11 user nova-compute[72818]:   </features>
Aug 17 21:56:11 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:56:11 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:56:11 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:56:11 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:56:11 user nova-compute[72818]:   </clock>
Aug 17 21:56:11 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:56:11 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:56:11 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:56:11 user nova-compute[72818]:   </cpu>
Aug 17 21:56:11 user nova-compute[72818]:   <devices>
Aug 17 21:56:11 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:56:11 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:56:11 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk"/>
Aug 17 21:56:11 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:56:11 user nova-compute[72818]:     </disk>
Aug 17 21:56:11 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:56:11 user nova-compute[72818]:       <mac address="fa:16:3e:96:5b:a2"/>
Aug 17 21:56:11 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:56:11 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:56:11 user nova-compute[72818]:       <target dev="tap43c02962-b5"/>
Aug 17 21:56:11 user nova-compute[72818]:     </interface>
Aug 17 21:56:11 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:56:11 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/console.log" append="off"/>
Aug 17 21:56:11 user nova-compute[72818]:     </serial>
Aug 17 21:56:11 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:56:11 user nova-compute[72818]:     <video>
Aug 17 21:56:11 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:56:11 user nova-compute[72818]:     </video>
Aug 17 21:56:11 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:56:11 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:56:11 user nova-compute[72818]:     </rng>
Aug 17 21:56:11 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:56:11 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:56:11 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:56:11 user nova-compute[72818]:     </memballoon>
Aug 17 21:56:11 user nova-compute[72818]:   </devices>
Aug 17 21:56:11 user nova-compute[72818]: </domain>
Aug 17 21:56:11 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-990799106',display_name='tempest-TestMinimumBasicScenario-server-990799106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-990799106',id=51,image_ref='f6fb3ce1-35fc-4d33-9a24-6d75177877b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6oNeNsuNUnFWJDxDz+9IRi1YC0RHi3RFoe4yOiqacct+p2P6CccvsrguXhqZc/kY+mEFByPZi/NhesYDfId0aVrCWyoECLLcP0tLAYicYnneMkt1e9AwDZhf51Fd/5Lg==',key_name='tempest-TestMinimumBasicScenario-904693589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29887fb0e7004a0e8ae9266e24b83590',ramdisk_id='',reservation_id='r-qp973neb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f6fb3ce1-35fc-4d33-9a24-6d75177877b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-433210411',owner_user_name='tempest-TestMinimumBasicScenario-433210411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:56:09Z,user_data=None,user_id='2d34610b992e405795f5a4d71fcdee44',uuid=dff19f99-0e58-4d0a-8cd4-6adf2142da7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converting VIF {"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG os_vif [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43c02962-b5, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43c02962-b5, col_values=(('external_ids', {'iface-id': '43c02962-b54c-4d84-bfd0-2150523456ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:5b:a2', 'vm-uuid': 'dff19f99-0e58-4d0a-8cd4-6adf2142da7c'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:11 user nova-compute[72818]: INFO os_vif [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5')
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:56:11 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] No VIF found with MAC fa:16:3e:96:5b:a2, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:56:12 user nova-compute[72818]: DEBUG nova.network.neutron [req-7d06d1be-f6cc-49be-b6c6-e9ef0045190b req-5605835c-3229-43ed-8b6e-e05ef88b32e4 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updated VIF entry in instance network info cache for port 43c02962-b54c-4d84-bfd0-2150523456ae. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:56:12 user nova-compute[72818]: DEBUG nova.network.neutron [req-7d06d1be-f6cc-49be-b6c6-e9ef0045190b req-5605835c-3229-43ed-8b6e-e05ef88b32e4 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:56:12 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7d06d1be-f6cc-49be-b6c6-e9ef0045190b req-5605835c-3229-43ed-8b6e-e05ef88b32e4 service nova] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:56:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-011453f9-75c6-40b9-aedd-c44b8d82eecf req-0db420f9-fd6e-4150-bc78-c5b1141b2009 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:56:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-011453f9-75c6-40b9-aedd-c44b8d82eecf req-0db420f9-fd6e-4150-bc78-c5b1141b2009 service nova] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:56:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-011453f9-75c6-40b9-aedd-c44b8d82eecf req-0db420f9-fd6e-4150-bc78-c5b1141b2009 service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:56:13 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-011453f9-75c6-40b9-aedd-c44b8d82eecf req-0db420f9-fd6e-4150-bc78-c5b1141b2009 service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:56:13 user nova-compute[72818]: DEBUG nova.compute.manager [req-011453f9-75c6-40b9-aedd-c44b8d82eecf req-0db420f9-fd6e-4150-bc78-c5b1141b2009 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] No waiting events found dispatching network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:56:13 user nova-compute[72818]: WARNING nova.compute.manager [req-011453f9-75c6-40b9-aedd-c44b8d82eecf req-0db420f9-fd6e-4150-bc78-c5b1141b2009 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received unexpected event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae for instance with vm_state building and task_state spawning.
Aug 17 21:56:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:13 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692309375.487762, dff19f99-0e58-4d0a-8cd4-6adf2142da7c => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:56:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] VM Resumed (Lifecycle Event)
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 21:56:15 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Instance spawned successfully.
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 21:56:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692309375.4917111, dff19f99-0e58-4d0a-8cd4-6adf2142da7c => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:56:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] VM Started (Lifecycle Event)
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-9c815f24-2b87-4665-9713-63cf7ddac3a1 req-823a9086-39d6-44ab-b597-6263b7fe7b2a service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9c815f24-2b87-4665-9713-63cf7ddac3a1 req-823a9086-39d6-44ab-b597-6263b7fe7b2a service nova] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9c815f24-2b87-4665-9713-63cf7ddac3a1 req-823a9086-39d6-44ab-b597-6263b7fe7b2a service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9c815f24-2b87-4665-9713-63cf7ddac3a1 req-823a9086-39d6-44ab-b597-6263b7fe7b2a service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.compute.manager [req-9c815f24-2b87-4665-9713-63cf7ddac3a1 req-823a9086-39d6-44ab-b597-6263b7fe7b2a service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] No waiting events found dispatching network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:56:15 user nova-compute[72818]: WARNING nova.compute.manager [req-9c815f24-2b87-4665-9713-63cf7ddac3a1 req-823a9086-39d6-44ab-b597-6263b7fe7b2a service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received unexpected event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae for instance with vm_state building and task_state spawning.
Aug 17 21:56:15 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 21:56:15 user nova-compute[72818]: INFO nova.compute.manager [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Took 6.54 seconds to spawn the instance on the hypervisor.
Aug 17 21:56:15 user nova-compute[72818]: DEBUG nova.compute.manager [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:56:15 user nova-compute[72818]: INFO nova.compute.manager [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Took 7.09 seconds to build instance.
Aug 17 21:56:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-99281f05-b6de-479e-8620-7b4fd63d110f tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.208s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:56:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:22 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:56:25 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:56:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:56:26 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:56:26 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:56:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:56:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:56:27 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:56:27 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:56:27 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:56:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:56:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:56:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:56:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:56:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:56:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:56:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:56:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:56:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:56:28 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:56:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:56:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:56:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:56:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:56:29 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:56:29 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:56:29 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=25.209491729736328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:56:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:56:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:56:29 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance dff19f99-0e58-4d0a-8cd4-6adf2142da7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:56:29 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:56:29 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:56:30 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing inventories for resource provider d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 21:56:30 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating ProviderTree inventory for provider d156e3af-684d-47e1-a951-585f9c95fa46 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 21:56:30 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 21:56:30 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing aggregate associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, aggregates: None {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 21:56:30 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing trait associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 21:56:30 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:56:30 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:56:30 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:56:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:56:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:56:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72818) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 21:56:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:32 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:56:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:56:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:56:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 21:56:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] There are 0 instances to clean {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 21:56:34 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:56:34 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:56:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:56:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:57:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:57:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:57:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:57:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:57:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:57:23 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:57:25 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:57:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:57:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:57:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:57:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:57:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:57:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:57:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:57:28 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:57:28 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:57:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:57:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:57:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:57:29 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:57:30 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:57:30 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:57:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:57:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:57:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:57:30 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:57:30 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:57:31 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:57:31 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:57:31 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=25.181114196777344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance dff19f99-0e58-4d0a-8cd4-6adf2142da7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:57:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:57:34 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:57:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:57:34 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:57:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:57:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:57:46 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:57:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:57:51 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:57:56 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:58:01 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:58:02 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:58:02 user nova-compute[72818]: DEBUG nova.objects.instance [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'flavor' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:58:03 user nova-compute[72818]: INFO nova.compute.manager [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Attaching volume d4ae2d7b-c538-4c77-ade3-84fde33b0bba to /dev/vdb
Aug 17 21:58:03 user nova-compute[72818]: DEBUG os_brick.utils [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a7e834-385d-46cc-9508-19a9cb579faa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8098b800-181a-4691-ae31-767fe66649d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7f607c-da89-46c3-9f64-32a487d571cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8af368-336c-44f7-bcc2-05a24a4942d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 21:58:03 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 21:58:03 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[128ddf8f-d313-4364-8b29-a1b7ee122735]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG os_brick.utils [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:58:03 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating existing volume attachment record: 6f47f818-68c3-4c1b-be1e-4569643811a3 {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 21:58:06 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:11 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmtgnrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:58:13 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:58:13 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:58:13 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[60de5ce8-a8c9-45e1-a738-141eb53dc785]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:58:13 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5156666f-af23-4c22-9445-a3f488458256]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba] added
Aug 17 21:58:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b2ff8d-87bd-452a-b76e-15e582f8ebcd]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a1f52a-1ac5-48fb-84f5-121a106147e5]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awmtgnrc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awmtgnrc" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c192166-f4c7-4de5-a93d-08f0b23d8619]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'awmtgnrc'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b66d9b-cd27-4c37-9a46-ee4ed9c9f17b]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4067b22-08d6-4cae-ae8f-7be5ddce7e05]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:58:13 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:58:13 user nova-compute[72818]:  {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:58:13 user nova-compute[72818]: WARNING os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 21:58:13 user nova-compute[72818]: 
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d4af0b-c7a3-404a-9120-ae9a9533cd0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260]
Aug 17 21:58:13 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260] successful.
Aug 17 21:58:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[360ace00-2ef0-4aef-b199-830cfad3646c]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc807086-3e97-4db2-b1a7-afe1ddf97aeb]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba (non-flash)
Aug 17 21:58:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba (non-flash)
Aug 17 21:58:13 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bd2e06-2ee1-4c71-8418-754ea15f1a7f]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:13 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:58:14 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:58:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmtgnrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:58:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:58:14 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23238633565653737', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:58:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238633565653737', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:58:14 user nova-compute[72818]: DEBUG nova.objects.instance [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'flavor' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:58:14 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 21:58:14 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:58:14 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 21:58:14 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 21:58:14 user nova-compute[72818]:   <serial>d4ae2d7b-c538-4c77-ade3-84fde33b0bba</serial>
Aug 17 21:58:14 user nova-compute[72818]: </disk>
Aug 17 21:58:14 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 21:58:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:58:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 21:58:15 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] No VIF found with MAC fa:16:3e:96:5b:a2, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 21:58:15 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-2a03203a-160a-4445-8c96-51f0f71ec3fe tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.062s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:58:16 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:58:21 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:58:24 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:58:25 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:58:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:58:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-6b6ddb6f-c84c-48f1-9cb7-a103c28c3bb7 req-473cb77a-9ccd-4f00-ae6d-92ecef79582e service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-changed-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:58:26 user nova-compute[72818]: DEBUG nova.compute.manager [req-6b6ddb6f-c84c-48f1-9cb7-a103c28c3bb7 req-473cb77a-9ccd-4f00-ae6d-92ecef79582e service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Refreshing instance network info cache due to event network-changed-43c02962-b54c-4d84-bfd0-2150523456ae. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:58:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6b6ddb6f-c84c-48f1-9cb7-a103c28c3bb7 req-473cb77a-9ccd-4f00-ae6d-92ecef79582e service nova] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:58:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6b6ddb6f-c84c-48f1-9cb7-a103c28c3bb7 req-473cb77a-9ccd-4f00-ae6d-92ecef79582e service nova] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:58:26 user nova-compute[72818]: DEBUG nova.network.neutron [req-6b6ddb6f-c84c-48f1-9cb7-a103c28c3bb7 req-473cb77a-9ccd-4f00-ae6d-92ecef79582e service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Refreshing network info cache for port 43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:58:26 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-6b6ddb6f-c84c-48f1-9cb7-a103c28c3bb7 req-473cb77a-9ccd-4f00-ae6d-92ecef79582e service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updated VIF entry in instance network info cache for port 43c02962-b54c-4d84-bfd0-2150523456ae. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:58:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-6b6ddb6f-c84c-48f1-9cb7-a103c28c3bb7 req-473cb77a-9ccd-4f00-ae6d-92ecef79582e service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:58:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-6b6ddb6f-c84c-48f1-9cb7-a103c28c3bb7 req-473cb77a-9ccd-4f00-ae6d-92ecef79582e service nova] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:58:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:58:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:58:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:58:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:58:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:58:28 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:58:28 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:58:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-fab12274-9987-4f41-ac89-fb14b1aa6d89 req-23fd28b7-8af7-4b05-bb57-24c04af30cc3 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-changed-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:58:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-fab12274-9987-4f41-ac89-fb14b1aa6d89 req-23fd28b7-8af7-4b05-bb57-24c04af30cc3 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Refreshing instance network info cache due to event network-changed-43c02962-b54c-4d84-bfd0-2150523456ae. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 21:58:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fab12274-9987-4f41-ac89-fb14b1aa6d89 req-23fd28b7-8af7-4b05-bb57-24c04af30cc3 service nova] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:58:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:58:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:58:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:58:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fab12274-9987-4f41-ac89-fb14b1aa6d89 req-23fd28b7-8af7-4b05-bb57-24c04af30cc3 service nova] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:58:29 user nova-compute[72818]: DEBUG nova.network.neutron [req-fab12274-9987-4f41-ac89-fb14b1aa6d89 req-23fd28b7-8af7-4b05-bb57-24c04af30cc3 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Refreshing network info cache for port 43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 21:58:29 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:58:29 user nova-compute[72818]: DEBUG nova.network.neutron [req-fab12274-9987-4f41-ac89-fb14b1aa6d89 req-23fd28b7-8af7-4b05-bb57-24c04af30cc3 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updated VIF entry in instance network info cache for port 43c02962-b54c-4d84-bfd0-2150523456ae. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 21:58:29 user nova-compute[72818]: DEBUG nova.network.neutron [req-fab12274-9987-4f41-ac89-fb14b1aa6d89 req-23fd28b7-8af7-4b05-bb57-24c04af30cc3 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:58:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fab12274-9987-4f41-ac89-fb14b1aa6d89 req-23fd28b7-8af7-4b05-bb57-24c04af30cc3 service nova] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:58:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:58:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:58:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:58:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:58:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:58:31 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:58:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:31 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:58:32 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:58:32 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:58:32 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=25.179771423339844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance dff19f99-0e58-4d0a-8cd4-6adf2142da7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:58:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:58:34 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:58:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:58:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:58:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:58:35 user nova-compute[72818]: INFO nova.compute.manager [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Rebooting instance
Aug 17 21:58:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:58:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:58:35 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG nova.network.neutron [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-1c5646c6-1845-4a30-ac15-e7386fa396a7 req-9b27345c-eb88-4369-8317-d01da6d3df62 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-unplugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1c5646c6-1845-4a30-ac15-e7386fa396a7 req-9b27345c-eb88-4369-8317-d01da6d3df62 service nova] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1c5646c6-1845-4a30-ac15-e7386fa396a7 req-9b27345c-eb88-4369-8317-d01da6d3df62 service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-1c5646c6-1845-4a30-ac15-e7386fa396a7 req-9b27345c-eb88-4369-8317-d01da6d3df62 service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG nova.compute.manager [req-1c5646c6-1845-4a30-ac15-e7386fa396a7 req-9b27345c-eb88-4369-8317-d01da6d3df62 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] No waiting events found dispatching network-vif-unplugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:58:36 user nova-compute[72818]: WARNING nova.compute.manager [req-1c5646c6-1845-4a30-ac15-e7386fa396a7 req-9b27345c-eb88-4369-8317-d01da6d3df62 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received unexpected event network-vif-unplugged-43c02962-b54c-4d84-bfd0-2150523456ae for instance with vm_state active and task_state reboot_started_hard.
Aug 17 21:58:36 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:58:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:37 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Instance destroyed successfully.
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.objects.instance [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'resources' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-990799106',display_name='tempest-TestMinimumBasicScenario-server-990799106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-990799106',id=51,image_ref='f6fb3ce1-35fc-4d33-9a24-6d75177877b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6oNeNsuNUnFWJDxDz+9IRi1YC0RHi3RFoe4yOiqacct+p2P6CccvsrguXhqZc/kY+mEFByPZi/NhesYDfId0aVrCWyoECLLcP0tLAYicYnneMkt1e9AwDZhf51Fd/5Lg==',key_name='tempest-TestMinimumBasicScenario-904693589',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29887fb0e7004a0e8ae9266e24b83590',ramdisk_id='',reservation_id='r-qp973neb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f6fb3ce1-35fc-4d33-9a24-6d75177877b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-433210411',owner_user_name='tempest-TestMinimumBasicScenario-433210411-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:58:36Z,user_data=None,user_id='2d34610b992e405795f5a4d71fcdee44',uuid=dff19f99-0e58-4d0a-8cd4-6adf2142da7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converting VIF {"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_vif [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43c02962-b5, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:58:37 user nova-compute[72818]: INFO os_vif [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5')
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmtgnrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:58:37 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33ed7d2-d137-4355-9f8b-73aa0a177ebf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02f3cb4-56e9-47c9-b660-b73b8d8ea01d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba (non-flash)
Aug 17 21:58:37 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba (non-flash)
Aug 17 21:58:37 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04dfc700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba94e07-e5a0-495e-bc88-3b3489007b13]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7add23ed-2f41-4b45-b5b9-ba873c0432e3]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0ac640-5e9f-4f59-9476-06ba925c4577]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a9af81-6f5c-469c-8127-61bf5ada1fb8]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf0954d-f349-4636-8bbd-790d2b81c375]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0cd850-eb9f-4b0b-8271-3ef87c2709fc]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260]
Aug 17 21:58:37 user nova-compute[72818]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260] successful.
Aug 17 21:58:37 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[296799b6-bb0c-40fb-b0ad-b3c6a938b72e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] <== disconnect_volume: return (248ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Start _get_guest_xml network_info=[{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f6fb3ce1-35fc-4d33-9a24-6d75177877b7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': 'f6fb3ce1-35fc-4d33-9a24-6d75177877b7'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '6f47f818-68c3-4c1b-be1e-4569643811a3', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmtgnrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'dff19f99-0e58-4d0a-8cd4-6adf2142da7c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4ae2d7b-c538-4c77-ade3-84fde33b0bba', 'serial': 'd4ae2d7b-c538-4c77-ade3-84fde33b0bba'}, 'volume_type': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 21:58:37 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:58:37 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f6fb3ce1-35fc-4d33-9a24-6d75177877b7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.objects.instance [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'vcpu_model' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmtgnrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 21:58:37 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:58:37 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 21:58:37 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cc3d41-28f4-45f9-a0b7-e604ead6170d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 21:58:37 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[727893d9-f664-484b-a040-e6a86237d4bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba] added
Aug 17 21:58:37 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b00558-1468-4fdd-8f45-93753e2caf49]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1a458c-dd0c-49c8-95ae-614cec33bde3]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awmtgnrc {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awmtgnrc" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad274bf-820c-409f-981e-f6734c0b453e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'awmtgnrc'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6cebce-fa3f-4511-9f12-5bd7eb05ff05]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ede0f09-2c38-4817-8c9b-3d98eea29fa0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:58:37 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 21:58:37 user nova-compute[72818]:  {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:58:37 user nova-compute[72818]: WARNING os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 21:58:37 user nova-compute[72818]: 
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d7d993-daa5-4719-b10b-6fb4b095458c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260]
Aug 17 21:58:37 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260] successful.
Aug 17 21:58:37 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4320687-ddbe-402f-a529-f06858bd81d1]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbcfe81-b332-4a05-b2e7-d21ad6b56363]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba (non-flash)
Aug 17 21:58:37 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba (non-flash)
Aug 17 21:58:37 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f76f3e-5fe0-4649-8528-a2f89ff739ae]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:58:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-b92cd4b8-0866-49af-a9c0-d979ab3e4281 req-426d4500-9513-47f2-8065-5546fe7be52f service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b92cd4b8-0866-49af-a9c0-d979ab3e4281 req-426d4500-9513-47f2-8065-5546fe7be52f service nova] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b92cd4b8-0866-49af-a9c0-d979ab3e4281 req-426d4500-9513-47f2-8065-5546fe7be52f service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-b92cd4b8-0866-49af-a9c0-d979ab3e4281 req-426d4500-9513-47f2-8065-5546fe7be52f service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG nova.compute.manager [req-b92cd4b8-0866-49af-a9c0-d979ab3e4281 req-426d4500-9513-47f2-8065-5546fe7be52f service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] No waiting events found dispatching network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:58:38 user nova-compute[72818]: WARNING nova.compute.manager [req-b92cd4b8-0866-49af-a9c0-d979ab3e4281 req-426d4500-9513-47f2-8065-5546fe7be52f service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received unexpected event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae for instance with vm_state active and task_state reboot_started_hard.
Aug 17 21:58:38 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmtgnrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23238633565653737', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238633565653737', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-990799106',display_name='tempest-TestMinimumBasicScenario-server-990799106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-990799106',id=51,image_ref='f6fb3ce1-35fc-4d33-9a24-6d75177877b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6oNeNsuNUnFWJDxDz+9IRi1YC0RHi3RFoe4yOiqacct+p2P6CccvsrguXhqZc/kY+mEFByPZi/NhesYDfId0aVrCWyoECLLcP0tLAYicYnneMkt1e9AwDZhf51Fd/5Lg==',key_name='tempest-TestMinimumBasicScenario-904693589',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29887fb0e7004a0e8ae9266e24b83590',ramdisk_id='',reservation_id='r-qp973neb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f6fb3ce1-35fc-4d33-9a24-6d75177877b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-433210411',owner_user_name='tempest-TestMinimumBasicScenario-433210411-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:58:36Z,user_data=None,user_id='2d34610b992e405795f5a4d71fcdee44',uuid=dff19f99-0e58-4d0a-8cd4-6adf2142da7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converting VIF {"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG nova.objects.instance [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'pci_devices' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 21:58:38 user nova-compute[72818]:   <uuid>dff19f99-0e58-4d0a-8cd4-6adf2142da7c</uuid>
Aug 17 21:58:38 user nova-compute[72818]:   <name>instance-00000033</name>
Aug 17 21:58:38 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 21:58:38 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 21:58:38 user nova-compute[72818]:   <metadata>
Aug 17 21:58:38 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 21:58:38 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 21:58:38 user nova-compute[72818]:       <nova:name>tempest-TestMinimumBasicScenario-server-990799106</nova:name>
Aug 17 21:58:38 user nova-compute[72818]:       <nova:creationTime>2023-08-17 21:58:37</nova:creationTime>
Aug 17 21:58:38 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 21:58:38 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 21:58:38 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 21:58:38 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 21:58:38 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 21:58:38 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 21:58:38 user nova-compute[72818]:       </nova:flavor>
Aug 17 21:58:38 user nova-compute[72818]:       <nova:owner>
Aug 17 21:58:38 user nova-compute[72818]:         <nova:user uuid="2d34610b992e405795f5a4d71fcdee44">tempest-TestMinimumBasicScenario-433210411-project-member</nova:user>
Aug 17 21:58:38 user nova-compute[72818]:         <nova:project uuid="29887fb0e7004a0e8ae9266e24b83590">tempest-TestMinimumBasicScenario-433210411</nova:project>
Aug 17 21:58:38 user nova-compute[72818]:       </nova:owner>
Aug 17 21:58:38 user nova-compute[72818]:       <nova:root type="image" uuid="f6fb3ce1-35fc-4d33-9a24-6d75177877b7"/>
Aug 17 21:58:38 user nova-compute[72818]:       <nova:ports>
Aug 17 21:58:38 user nova-compute[72818]:         <nova:port uuid="43c02962-b54c-4d84-bfd0-2150523456ae">
Aug 17 21:58:38 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 21:58:38 user nova-compute[72818]:         </nova:port>
Aug 17 21:58:38 user nova-compute[72818]:       </nova:ports>
Aug 17 21:58:38 user nova-compute[72818]:     </nova:instance>
Aug 17 21:58:38 user nova-compute[72818]:   </metadata>
Aug 17 21:58:38 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 21:58:38 user nova-compute[72818]:     <system>
Aug 17 21:58:38 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 21:58:38 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 21:58:38 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 21:58:38 user nova-compute[72818]:       <entry name="serial">dff19f99-0e58-4d0a-8cd4-6adf2142da7c</entry>
Aug 17 21:58:38 user nova-compute[72818]:       <entry name="uuid">dff19f99-0e58-4d0a-8cd4-6adf2142da7c</entry>
Aug 17 21:58:38 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 21:58:38 user nova-compute[72818]:     </system>
Aug 17 21:58:38 user nova-compute[72818]:   </sysinfo>
Aug 17 21:58:38 user nova-compute[72818]:   <os>
Aug 17 21:58:38 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 21:58:38 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 21:58:38 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 21:58:38 user nova-compute[72818]:   </os>
Aug 17 21:58:38 user nova-compute[72818]:   <features>
Aug 17 21:58:38 user nova-compute[72818]:     <acpi/>
Aug 17 21:58:38 user nova-compute[72818]:     <apic/>
Aug 17 21:58:38 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 21:58:38 user nova-compute[72818]:   </features>
Aug 17 21:58:38 user nova-compute[72818]:   <clock offset="utc">
Aug 17 21:58:38 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 21:58:38 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 21:58:38 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 21:58:38 user nova-compute[72818]:   </clock>
Aug 17 21:58:38 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 21:58:38 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 21:58:38 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 21:58:38 user nova-compute[72818]:   </cpu>
Aug 17 21:58:38 user nova-compute[72818]:   <devices>
Aug 17 21:58:38 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 21:58:38 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 21:58:38 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk"/>
Aug 17 21:58:38 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 21:58:38 user nova-compute[72818]:     </disk>
Aug 17 21:58:38 user nova-compute[72818]:     <disk type="block" device="disk">
Aug 17 21:58:38 user nova-compute[72818]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 21:58:38 user nova-compute[72818]:       <source dev="/dev/sdb"/>
Aug 17 21:58:38 user nova-compute[72818]:       <target dev="vdb" bus="virtio"/>
Aug 17 21:58:38 user nova-compute[72818]:       <serial>d4ae2d7b-c538-4c77-ade3-84fde33b0bba</serial>
Aug 17 21:58:38 user nova-compute[72818]:     </disk>
Aug 17 21:58:38 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 21:58:38 user nova-compute[72818]:       <mac address="fa:16:3e:96:5b:a2"/>
Aug 17 21:58:38 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:58:38 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 21:58:38 user nova-compute[72818]:       <target dev="tap43c02962-b5"/>
Aug 17 21:58:38 user nova-compute[72818]:     </interface>
Aug 17 21:58:38 user nova-compute[72818]:     <serial type="pty">
Aug 17 21:58:38 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/console.log" append="off"/>
Aug 17 21:58:38 user nova-compute[72818]:     </serial>
Aug 17 21:58:38 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 21:58:38 user nova-compute[72818]:     <video>
Aug 17 21:58:38 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 21:58:38 user nova-compute[72818]:     </video>
Aug 17 21:58:38 user nova-compute[72818]:     <rng model="virtio">
Aug 17 21:58:38 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 21:58:38 user nova-compute[72818]:     </rng>
Aug 17 21:58:38 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 21:58:38 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 21:58:38 user nova-compute[72818]:       <stats period="10"/>
Aug 17 21:58:38 user nova-compute[72818]:     </memballoon>
Aug 17 21:58:38 user nova-compute[72818]:   </devices>
Aug 17 21:58:38 user nova-compute[72818]: </domain>
Aug 17 21:58:38 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG nova.objects.instance [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'trusted_certs' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03 --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8330be8c1a235cc3178e6699f8f242493f0cbb03 --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Cannot resize image /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG nova.objects.instance [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'migration_context' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-990799106',display_name='tempest-TestMinimumBasicScenario-server-990799106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-990799106',id=51,image_ref='f6fb3ce1-35fc-4d33-9a24-6d75177877b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6oNeNsuNUnFWJDxDz+9IRi1YC0RHi3RFoe4yOiqacct+p2P6CccvsrguXhqZc/kY+mEFByPZi/NhesYDfId0aVrCWyoECLLcP0tLAYicYnneMkt1e9AwDZhf51Fd/5Lg==',key_name='tempest-TestMinimumBasicScenario-904693589',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='29887fb0e7004a0e8ae9266e24b83590',ramdisk_id='',reservation_id='r-qp973neb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f6fb3ce1-35fc-4d33-9a24-6d75177877b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-433210411',owner_user_name='tempest-TestMinimumBasicScenario-433210411-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T21:58:36Z,user_data=None,user_id='2d34610b992e405795f5a4d71fcdee44',uuid=dff19f99-0e58-4d0a-8cd4-6adf2142da7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converting VIF {"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG os_vif [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43c02962-b5, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43c02962-b5, col_values=(('external_ids', {'iface-id': '43c02962-b54c-4d84-bfd0-2150523456ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:5b:a2', 'vm-uuid': 'dff19f99-0e58-4d0a-8cd4-6adf2142da7c'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:58:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:39 user nova-compute[72818]: INFO os_vif [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5')
Aug 17 21:58:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-9e9ef57b-db48-47ff-b142-b0ad0c3757dc req-37558d15-92ec-4446-b4b8-bb0b0823c358 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:58:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9e9ef57b-db48-47ff-b142-b0ad0c3757dc req-37558d15-92ec-4446-b4b8-bb0b0823c358 service nova] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:58:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9e9ef57b-db48-47ff-b142-b0ad0c3757dc req-37558d15-92ec-4446-b4b8-bb0b0823c358 service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:58:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9e9ef57b-db48-47ff-b142-b0ad0c3757dc req-37558d15-92ec-4446-b4b8-bb0b0823c358 service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:58:41 user nova-compute[72818]: DEBUG nova.compute.manager [req-9e9ef57b-db48-47ff-b142-b0ad0c3757dc req-37558d15-92ec-4446-b4b8-bb0b0823c358 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] No waiting events found dispatching network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:58:41 user nova-compute[72818]: WARNING nova.compute.manager [req-9e9ef57b-db48-47ff-b142-b0ad0c3757dc req-37558d15-92ec-4446-b4b8-bb0b0823c358 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received unexpected event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae for instance with vm_state active and task_state reboot_started_hard.
Aug 17 21:58:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:41 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:42 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for dff19f99-0e58-4d0a-8cd4-6adf2142da7c due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 21:58:42 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692309522.9638882, dff19f99-0e58-4d0a-8cd4-6adf2142da7c => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:58:42 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] VM Resumed (Lifecycle Event)
Aug 17 21:58:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 21:58:42 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Instance rebooted successfully.
Aug 17 21:58:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:58:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:58:42 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:58:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 17 21:58:43 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692309522.9658775, dff19f99-0e58-4d0a-8cd4-6adf2142da7c => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 21:58:43 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] VM Started (Lifecycle Event)
Aug 17 21:58:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 21:58:43 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 21:58:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-3de82dcd-7f01-4fbf-bade-8e3b6432d69b tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.286s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:58:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-4a6b3051-b8bb-4fc2-b4da-aa2f059440b3 req-39186fd0-6e20-4578-8e86-07ba95566c63 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 21:58:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4a6b3051-b8bb-4fc2-b4da-aa2f059440b3 req-39186fd0-6e20-4578-8e86-07ba95566c63 service nova] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:58:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4a6b3051-b8bb-4fc2-b4da-aa2f059440b3 req-39186fd0-6e20-4578-8e86-07ba95566c63 service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:58:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4a6b3051-b8bb-4fc2-b4da-aa2f059440b3 req-39186fd0-6e20-4578-8e86-07ba95566c63 service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:58:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-4a6b3051-b8bb-4fc2-b4da-aa2f059440b3 req-39186fd0-6e20-4578-8e86-07ba95566c63 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] No waiting events found dispatching network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 21:58:43 user nova-compute[72818]: WARNING nova.compute.manager [req-4a6b3051-b8bb-4fc2-b4da-aa2f059440b3 req-39186fd0-6e20-4578-8e86-07ba95566c63 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received unexpected event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae for instance with vm_state active and task_state None.
Aug 17 21:58:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:58:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:59:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:59:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:59:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:59:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:59:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:59:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:59:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:59:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:59:24 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:59:25 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:59:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:59:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:59:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 21:59:28 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 21:59:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 21:59:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 21:59:28 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 21:59:28 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 21:59:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 21:59:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 21:59:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 21:59:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:59:29 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:59:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:59:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:59:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 21:59:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:59:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:59:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:59:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:59:33 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 21:59:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:59:34 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:59:34 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 21:59:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=25.170352935791016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance dff19f99-0e58-4d0a-8cd4-6adf2142da7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 21:59:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 21:59:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 21:59:39 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:59:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:59:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 21:59:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:59:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 21:59:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:00:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:25 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:00:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:00:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:27 user nova-compute[72818]: DEBUG nova.compute.manager [req-a78f0a66-0aed-4f94-8219-2e058f9c359c req-c338a206-6454-44fc-b937-a7abfaad39c1 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-changed-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:00:27 user nova-compute[72818]: DEBUG nova.compute.manager [req-a78f0a66-0aed-4f94-8219-2e058f9c359c req-c338a206-6454-44fc-b937-a7abfaad39c1 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Refreshing instance network info cache due to event network-changed-43c02962-b54c-4d84-bfd0-2150523456ae. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 22:00:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a78f0a66-0aed-4f94-8219-2e058f9c359c req-c338a206-6454-44fc-b937-a7abfaad39c1 service nova] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:00:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a78f0a66-0aed-4f94-8219-2e058f9c359c req-c338a206-6454-44fc-b937-a7abfaad39c1 service nova] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:00:27 user nova-compute[72818]: DEBUG nova.network.neutron [req-a78f0a66-0aed-4f94-8219-2e058f9c359c req-c338a206-6454-44fc-b937-a7abfaad39c1 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Refreshing network info cache for port 43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 22:00:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG nova.network.neutron [req-a78f0a66-0aed-4f94-8219-2e058f9c359c req-c338a206-6454-44fc-b937-a7abfaad39c1 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updated VIF entry in instance network info cache for port 43c02962-b54c-4d84-bfd0-2150523456ae. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG nova.network.neutron [req-a78f0a66-0aed-4f94-8219-2e058f9c359c req-c338a206-6454-44fc-b937-a7abfaad39c1 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a78f0a66-0aed-4f94-8219-2e058f9c359c req-c338a206-6454-44fc-b937-a7abfaad39c1 service nova] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-2615f303-e04a-4119-9ac0-36ab2f666c53 req-cc25a003-3883-491f-b942-de54c62ab7de service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-changed-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-2615f303-e04a-4119-9ac0-36ab2f666c53 req-cc25a003-3883-491f-b942-de54c62ab7de service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Refreshing instance network info cache due to event network-changed-43c02962-b54c-4d84-bfd0-2150523456ae. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2615f303-e04a-4119-9ac0-36ab2f666c53 req-cc25a003-3883-491f-b942-de54c62ab7de service nova] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2615f303-e04a-4119-9ac0-36ab2f666c53 req-cc25a003-3883-491f-b942-de54c62ab7de service nova] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG nova.network.neutron [req-2615f303-e04a-4119-9ac0-36ab2f666c53 req-cc25a003-3883-491f-b942-de54c62ab7de service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Refreshing network info cache for port 43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:00:28 user nova-compute[72818]: INFO nova.compute.manager [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Detaching volume d4ae2d7b-c538-4c77-ade3-84fde33b0bba
Aug 17 22:00:28 user nova-compute[72818]: INFO nova.virt.block_device [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Attempting to driver detach volume d4ae2d7b-c538-4c77-ade3-84fde33b0bba from mountpoint /dev/vdb
Aug 17 22:00:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Attempting to detach device vdb from instance dff19f99-0e58-4d0a-8cd4-6adf2142da7c from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 22:00:28 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 22:00:28 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 22:00:28 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 22:00:28 user nova-compute[72818]:   <serial>d4ae2d7b-c538-4c77-ade3-84fde33b0bba</serial>
Aug 17 22:00:28 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 22:00:28 user nova-compute[72818]: </disk>
Aug 17 22:00:28 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 22:00:28 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Successfully detached device vdb from instance dff19f99-0e58-4d0a-8cd4-6adf2142da7c from the persistent domain config.
Aug 17 22:00:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dff19f99-0e58-4d0a-8cd4-6adf2142da7c from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 22:00:28 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 22:00:28 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 22:00:28 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 22:00:28 user nova-compute[72818]:   <serial>d4ae2d7b-c538-4c77-ade3-84fde33b0bba</serial>
Aug 17 22:00:28 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 22:00:28 user nova-compute[72818]: </disk>
Aug 17 22:00:28 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG nova.network.neutron [req-2615f303-e04a-4119-9ac0-36ab2f666c53 req-cc25a003-3883-491f-b942-de54c62ab7de service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updated VIF entry in instance network info cache for port 43c02962-b54c-4d84-bfd0-2150523456ae. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG nova.network.neutron [req-2615f303-e04a-4119-9ac0-36ab2f666c53 req-cc25a003-3883-491f-b942-de54c62ab7de service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:00:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-2615f303-e04a-4119-9ac0-36ab2f666c53 req-cc25a003-3883-491f-b942-de54c62ab7de service nova] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692309629.2037263, dff19f99-0e58-4d0a-8cd4-6adf2142da7c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 22:00:29 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Successfully detached device vdb from instance dff19f99-0e58-4d0a-8cd4-6adf2142da7c from the live domain config.
Aug 17 22:00:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmtgnrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 22:00:29 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d68f171-280c-4124-9eff-02a384254ac2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b64280-2285-4fc8-b455-6e75fc576c1b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba (non-flash)
Aug 17 22:00:29 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba (non-flash)
Aug 17 22:00:29 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04e65870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de0a2da-b104-41c5-aa38-8d57dda0295b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7428081-4469-4c4d-aaa9-e9d768d15005]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5a7761-39ac-43c8-a0ad-4deaf94f90b9]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc40eca8-05ad-4cf5-8bfc-21fd1f4f6155]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[214f5f26-7d01-4a3c-8f7e-43ced56960df]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f615c315-855d-41b2-8093-d8f2a8a533d8]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260]
Aug 17 22:00:29 user nova-compute[72818]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba, portal: 172.16.0.220,3260] successful.
Aug 17 22:00:29 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ae2d7b-c538-4c77-ade3-84fde33b0bba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb4fc70-d047-4ecd-a0ef-ebdc06cdb28e]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] <== disconnect_volume: return (279ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 22:00:29 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:00:30 user nova-compute[72818]: DEBUG nova.objects.instance [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'flavor' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:00:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-66383614-8afd-4244-98ab-dbd86cd6b6fc tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.791s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:00:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:00:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:00:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 22:00:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:00:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:00:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:00:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 22:00:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:00:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:00:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:00:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:00:33 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 22:00:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:00:34 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:00:34 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:00:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=25.169578552246094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance dff19f99-0e58-4d0a-8cd4-6adf2142da7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 22:00:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:00:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:00:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:00:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:00:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:00:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:40 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:00:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:00:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:01:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:01:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:01:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:29 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 22:01:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 22:01:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:01:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:01:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 22:01:30 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:01:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [{"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:01:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-dff19f99-0e58-4d0a-8cd4-6adf2142da7c" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:01:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 22:01:30 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:01:32 user nova-compute[72818]: INFO nova.compute.manager [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Terminating instance
Aug 17 22:01:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-9252bdf0-35cc-4138-a5a5-b799006460bf req-a3efead6-494f-454f-9ccd-c43536b6b818 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-unplugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9252bdf0-35cc-4138-a5a5-b799006460bf req-a3efead6-494f-454f-9ccd-c43536b6b818 service nova] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9252bdf0-35cc-4138-a5a5-b799006460bf req-a3efead6-494f-454f-9ccd-c43536b6b818 service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9252bdf0-35cc-4138-a5a5-b799006460bf req-a3efead6-494f-454f-9ccd-c43536b6b818 service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-9252bdf0-35cc-4138-a5a5-b799006460bf req-a3efead6-494f-454f-9ccd-c43536b6b818 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] No waiting events found dispatching network-vif-unplugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-9252bdf0-35cc-4138-a5a5-b799006460bf req-a3efead6-494f-454f-9ccd-c43536b6b818 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-unplugged-43c02962-b54c-4d84-bfd0-2150523456ae for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:32 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Instance destroyed successfully.
Aug 17 22:01:32 user nova-compute[72818]: DEBUG nova.objects.instance [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'resources' on Instance uuid dff19f99-0e58-4d0a-8cd4-6adf2142da7c {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T21:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-990799106',display_name='tempest-TestMinimumBasicScenario-server-990799106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-990799106',id=51,image_ref='f6fb3ce1-35fc-4d33-9a24-6d75177877b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6oNeNsuNUnFWJDxDz+9IRi1YC0RHi3RFoe4yOiqacct+p2P6CccvsrguXhqZc/kY+mEFByPZi/NhesYDfId0aVrCWyoECLLcP0tLAYicYnneMkt1e9AwDZhf51Fd/5Lg==',key_name='tempest-TestMinimumBasicScenario-904693589',keypairs=<?>,launch_index=0,launched_at=2023-08-17T21:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29887fb0e7004a0e8ae9266e24b83590',ramdisk_id='',reservation_id='r-qp973neb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f6fb3ce1-35fc-4d33-9a24-6d75177877b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-433210411',owner_user_name='tempest-TestMinimumBasicScenario-433210411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T21:58:43Z,user_data=None,user_id='2d34610b992e405795f5a4d71fcdee44',uuid=dff19f99-0e58-4d0a-8cd4-6adf2142da7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converting VIF {"id": "43c02962-b54c-4d84-bfd0-2150523456ae", "address": "fa:16:3e:96:5b:a2", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c02962-b5", "ovs_interfaceid": "43c02962-b54c-4d84-bfd0-2150523456ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG os_vif [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43c02962-b5, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:01:32 user nova-compute[72818]: INFO os_vif [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=43c02962-b54c-4d84-bfd0-2150523456ae,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c02962-b5')
Aug 17 22:01:32 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Deleting instance files /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c_del
Aug 17 22:01:32 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Deletion of /opt/stack/data/nova/instances/dff19f99-0e58-4d0a-8cd4-6adf2142da7c_del complete
Aug 17 22:01:33 user nova-compute[72818]: INFO nova.compute.manager [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 22:01:33 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:33 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Took 0.80 seconds to deallocate network for instance.
Aug 17 22:01:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:01:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-ebbbb82c-fb7f-4c1e-9907-378719956434 req-6bc9d0f0-abc6-4955-bf10-fe8f6c92c462 service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-deleted-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Refreshing inventories for resource provider d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 22:01:34 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:01:34 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8894MB free_disk=25.196861267089844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Updating ProviderTree inventory for provider d156e3af-684d-47e1-a951-585f9c95fa46 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Refreshing aggregate associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, aggregates: None {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Refreshing trait associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.593s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.186s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:01:34 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Deleted allocations for instance dff19f99-0e58-4d0a-8cd4-6adf2142da7c
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-42551acc-6e41-4256-9afc-e4c7095c7099 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.478s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] No waiting events found dispatching network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:01:34 user nova-compute[72818]: WARNING nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received unexpected event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae for instance with vm_state deleted and task_state None.
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] No waiting events found dispatching network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:01:34 user nova-compute[72818]: WARNING nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received unexpected event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae for instance with vm_state deleted and task_state None.
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] No waiting events found dispatching network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:01:34 user nova-compute[72818]: WARNING nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received unexpected event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae for instance with vm_state deleted and task_state None.
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-unplugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] No waiting events found dispatching network-vif-unplugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:01:34 user nova-compute[72818]: WARNING nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received unexpected event network-vif-unplugged-43c02962-b54c-4d84-bfd0-2150523456ae for instance with vm_state deleted and task_state None.
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Acquiring lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] Lock "dff19f99-0e58-4d0a-8cd4-6adf2142da7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] No waiting events found dispatching network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:01:34 user nova-compute[72818]: WARNING nova.compute.manager [req-d5bc2bee-77f4-43a7-9140-e58b7aa47bfa req-1406262f-0e49-4bd7-b69f-79c08e14e6cc service nova] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Received unexpected event network-vif-plugged-43c02962-b54c-4d84-bfd0-2150523456ae for instance with vm_state deleted and task_state None.
Aug 17 22:01:34 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 22:01:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:01:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:01:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:01:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:01:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:01:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:45 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72818) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 22:01:47 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 22:01:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] There are 0 instances to clean {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 22:01:47 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692309692.8981206, dff19f99-0e58-4d0a-8cd4-6adf2142da7c => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 22:01:47 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] VM Stopped (Lifecycle Event)
Aug 17 22:01:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-cfb0d697-6b19-44cd-bfaf-e6eec0b1ee83 None None] [instance: dff19f99-0e58-4d0a-8cd4-6adf2142da7c] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 22:01:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:01:53 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:01:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:01:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:01:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:01:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:01:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:01:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:02:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:02:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:02:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:02:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:02:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:02:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:02:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:02:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:02:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:02:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:02:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:02:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:02:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:02:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:02:22 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:02:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:02:26 user nova-compute[72818]: DEBUG nova.compute.manager [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Starting instance... {{(pid=72818) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 22:02:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:02:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:02:26 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72818) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 22:02:26 user nova-compute[72818]: INFO nova.compute.claims [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Claim successful on node user
Aug 17 22:02:26 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:02:26 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 22:02:26 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 22:02:26 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:02:26 user nova-compute[72818]: DEBUG nova.compute.manager [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Start building networks asynchronously for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 22:02:26 user nova-compute[72818]: DEBUG nova.compute.manager [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Allocating IP information in the background. {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 22:02:26 user nova-compute[72818]: DEBUG nova.network.neutron [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] allocate_for_instance() {{(pid=72818) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 22:02:26 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 22:02:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Start building block device mappings for instance. {{(pid=72818) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG nova.policy [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d34610b992e405795f5a4d71fcdee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29887fb0e7004a0e8ae9266e24b83590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72818) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG nova.compute.manager [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Start spawning the instance on the hypervisor. {{(pid=72818) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Creating instance directory {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 22:02:27 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Creating image(s)
Aug 17 22:02:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "/opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "/opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "e3fc2fd29c5cd029d07e8148aa51c36ee404c50b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "e3fc2fd29c5cd029d07e8148aa51c36ee404c50b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b.part --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b.part --force-share --output=json" returned: 0 in 0.196s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG nova.virt.images [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] 2eaf2462-0c8b-4cc4-ac95-e20e8af9f8c7 was qcow2, converting to raw {{(pid=72818) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG nova.privsep.utils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72818) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b.part /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b.converted {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:02:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG nova.network.neutron [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Successfully created port: 5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b.part /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b.converted" returned: 0 in 0.417s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b.converted --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "e3fc2fd29c5cd029d07e8148aa51c36ee404c50b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.398s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "e3fc2fd29c5cd029d07e8148aa51c36ee404c50b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "e3fc2fd29c5cd029d07e8148aa51c36ee404c50b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG nova.network.neutron [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Successfully updated port: 5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b --force-share --output=json" returned: 0 in 0.195s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b,backing_fmt=raw /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk 1073741824 {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-42b0a4d8-c72b-48bb-a299-4958f619a18a req-e2090b44-9300-454c-a772-caeabd89d75e service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-changed-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG nova.compute.manager [req-42b0a4d8-c72b-48bb-a299-4958f619a18a req-e2090b44-9300-454c-a772-caeabd89d75e service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Refreshing instance network info cache due to event network-changed-5149ee8c-f57b-4fcc-b317-7cd90e54e47b. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-42b0a4d8-c72b-48bb-a299-4958f619a18a req-e2090b44-9300-454c-a772-caeabd89d75e service nova] Acquiring lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-42b0a4d8-c72b-48bb-a299-4958f619a18a req-e2090b44-9300-454c-a772-caeabd89d75e service nova] Acquired lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG nova.network.neutron [req-42b0a4d8-c72b-48bb-a299-4958f619a18a req-e2090b44-9300-454c-a772-caeabd89d75e service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Refreshing network info cache for port 5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b,backing_fmt=raw /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk 1073741824" returned: 0 in 0.058s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "e3fc2fd29c5cd029d07e8148aa51c36ee404c50b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:02:28 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.network.neutron [req-42b0a4d8-c72b-48bb-a299-4958f619a18a req-e2090b44-9300-454c-a772-caeabd89d75e service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3fc2fd29c5cd029d07e8148aa51c36ee404c50b --force-share --output=json" returned: 0 in 0.174s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk. size=1073741824 {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.network.neutron [req-42b0a4d8-c72b-48bb-a299-4958f619a18a req-e2090b44-9300-454c-a772-caeabd89d75e service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-42b0a4d8-c72b-48bb-a299-4958f619a18a req-e2090b44-9300-454c-a772-caeabd89d75e service nova] Releasing lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquired lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.disk.api [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Cannot resize image /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk to a smaller size. {{(pid=72818) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.objects.instance [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'migration_context' on Instance uuid ce38edc9-c3d7-4187-a8aa-97e2281b15a4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Created local disks {{(pid=72818) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Ensure instance console log exists: /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/console.log {{(pid=72818) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Instance cache missing network info. {{(pid=72818) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating instance_info_cache with network_info: [{"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Releasing lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Instance network_info: |[{"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72818) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Start _get_guest_xml network_info=[{"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T22:02:24Z,direct_url=<?>,disk_format='qcow2',id=2eaf2462-0c8b-4cc4-ac95-e20e8af9f8c7,min_disk=0,min_ram=0,name='tempest-scenario-img--2134590605',owner='29887fb0e7004a0e8ae9266e24b83590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T22:02:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'size': 0, 'image_id': '2eaf2462-0c8b-4cc4-ac95-e20e8af9f8c7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 22:02:29 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:02:29 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CPU controller missing on host. {{(pid=72818) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CPU controller found on host. {{(pid=72818) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72818) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T21:10:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T22:02:24Z,direct_url=<?>,disk_format='qcow2',id=2eaf2462-0c8b-4cc4-ac95-e20e8af9f8c7,min_disk=0,min_ram=0,name='tempest-scenario-img--2134590605',owner='29887fb0e7004a0e8ae9266e24b83590',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T22:02:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Flavor limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Image limits 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Flavor pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Image pref 0:0:0 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Got 1 possible topologies {{(pid=72818) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.hardware [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72818) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T22:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1329937507',display_name='tempest-TestMinimumBasicScenario-server-1329937507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1329937507',id=52,image_ref='2eaf2462-0c8b-4cc4-ac95-e20e8af9f8c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh7gZWvKmcWfRpNLruw39/YJ3iAs75gJ/5tYSBz4Yggmgk/uJSANMCJR5aPyes6vfip5SgihZGbuzJx+55qYsI6DBOGmzjFuIFNMFTsVzuSAOtdi4mxIhoKAICg8hOqrA==',key_name='tempest-TestMinimumBasicScenario-1895059836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29887fb0e7004a0e8ae9266e24b83590',ramdisk_id='',reservation_id='r-exn2dvsp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2eaf2462-0c8b-4cc4-ac95-e20e8af9f8c7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-433210411',owner_user_name='tempest-TestMinimumBasicScenario-433210411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T22:02:27Z,user_data=None,user_id='2d34610b992e405795f5a4d71fcdee44',uuid=ce38edc9-c3d7-4187-a8aa-97e2281b15a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72818) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converting VIF {"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:43:56,bridge_name='br-int',has_traffic_filtering=True,id=5149ee8c-f57b-4fcc-b317-7cd90e54e47b,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5149ee8c-f5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.objects.instance [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'pci_devices' on Instance uuid ce38edc9-c3d7-4187-a8aa-97e2281b15a4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 22:02:29 user nova-compute[72818]:   <uuid>ce38edc9-c3d7-4187-a8aa-97e2281b15a4</uuid>
Aug 17 22:02:29 user nova-compute[72818]:   <name>instance-00000034</name>
Aug 17 22:02:29 user nova-compute[72818]:   <memory>524288</memory>
Aug 17 22:02:29 user nova-compute[72818]:   <vcpu>1</vcpu>
Aug 17 22:02:29 user nova-compute[72818]:   <metadata>
Aug 17 22:02:29 user nova-compute[72818]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 22:02:29 user nova-compute[72818]:       <nova:package version="0.0.0"/>
Aug 17 22:02:29 user nova-compute[72818]:       <nova:name>tempest-TestMinimumBasicScenario-server-1329937507</nova:name>
Aug 17 22:02:29 user nova-compute[72818]:       <nova:creationTime>2023-08-17 22:02:29</nova:creationTime>
Aug 17 22:02:29 user nova-compute[72818]:       <nova:flavor name="m1.tiny">
Aug 17 22:02:29 user nova-compute[72818]:         <nova:memory>512</nova:memory>
Aug 17 22:02:29 user nova-compute[72818]:         <nova:disk>1</nova:disk>
Aug 17 22:02:29 user nova-compute[72818]:         <nova:swap>0</nova:swap>
Aug 17 22:02:29 user nova-compute[72818]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 22:02:29 user nova-compute[72818]:         <nova:vcpus>1</nova:vcpus>
Aug 17 22:02:29 user nova-compute[72818]:       </nova:flavor>
Aug 17 22:02:29 user nova-compute[72818]:       <nova:owner>
Aug 17 22:02:29 user nova-compute[72818]:         <nova:user uuid="2d34610b992e405795f5a4d71fcdee44">tempest-TestMinimumBasicScenario-433210411-project-member</nova:user>
Aug 17 22:02:29 user nova-compute[72818]:         <nova:project uuid="29887fb0e7004a0e8ae9266e24b83590">tempest-TestMinimumBasicScenario-433210411</nova:project>
Aug 17 22:02:29 user nova-compute[72818]:       </nova:owner>
Aug 17 22:02:29 user nova-compute[72818]:       <nova:root type="image" uuid="2eaf2462-0c8b-4cc4-ac95-e20e8af9f8c7"/>
Aug 17 22:02:29 user nova-compute[72818]:       <nova:ports>
Aug 17 22:02:29 user nova-compute[72818]:         <nova:port uuid="5149ee8c-f57b-4fcc-b317-7cd90e54e47b">
Aug 17 22:02:29 user nova-compute[72818]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 22:02:29 user nova-compute[72818]:         </nova:port>
Aug 17 22:02:29 user nova-compute[72818]:       </nova:ports>
Aug 17 22:02:29 user nova-compute[72818]:     </nova:instance>
Aug 17 22:02:29 user nova-compute[72818]:   </metadata>
Aug 17 22:02:29 user nova-compute[72818]:   <sysinfo type="smbios">
Aug 17 22:02:29 user nova-compute[72818]:     <system>
Aug 17 22:02:29 user nova-compute[72818]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 22:02:29 user nova-compute[72818]:       <entry name="product">OpenStack Nova</entry>
Aug 17 22:02:29 user nova-compute[72818]:       <entry name="version">0.0.0</entry>
Aug 17 22:02:29 user nova-compute[72818]:       <entry name="serial">ce38edc9-c3d7-4187-a8aa-97e2281b15a4</entry>
Aug 17 22:02:29 user nova-compute[72818]:       <entry name="uuid">ce38edc9-c3d7-4187-a8aa-97e2281b15a4</entry>
Aug 17 22:02:29 user nova-compute[72818]:       <entry name="family">Virtual Machine</entry>
Aug 17 22:02:29 user nova-compute[72818]:     </system>
Aug 17 22:02:29 user nova-compute[72818]:   </sysinfo>
Aug 17 22:02:29 user nova-compute[72818]:   <os>
Aug 17 22:02:29 user nova-compute[72818]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 22:02:29 user nova-compute[72818]:     <boot dev="hd"/>
Aug 17 22:02:29 user nova-compute[72818]:     <smbios mode="sysinfo"/>
Aug 17 22:02:29 user nova-compute[72818]:   </os>
Aug 17 22:02:29 user nova-compute[72818]:   <features>
Aug 17 22:02:29 user nova-compute[72818]:     <acpi/>
Aug 17 22:02:29 user nova-compute[72818]:     <apic/>
Aug 17 22:02:29 user nova-compute[72818]:     <vmcoreinfo/>
Aug 17 22:02:29 user nova-compute[72818]:   </features>
Aug 17 22:02:29 user nova-compute[72818]:   <clock offset="utc">
Aug 17 22:02:29 user nova-compute[72818]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 22:02:29 user nova-compute[72818]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 22:02:29 user nova-compute[72818]:     <timer name="hpet" present="no"/>
Aug 17 22:02:29 user nova-compute[72818]:   </clock>
Aug 17 22:02:29 user nova-compute[72818]:   <cpu mode="custom" match="exact">
Aug 17 22:02:29 user nova-compute[72818]:     <model>Nehalem</model>
Aug 17 22:02:29 user nova-compute[72818]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 22:02:29 user nova-compute[72818]:   </cpu>
Aug 17 22:02:29 user nova-compute[72818]:   <devices>
Aug 17 22:02:29 user nova-compute[72818]:     <disk type="file" device="disk">
Aug 17 22:02:29 user nova-compute[72818]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 22:02:29 user nova-compute[72818]:       <source file="/opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk"/>
Aug 17 22:02:29 user nova-compute[72818]:       <target dev="vda" bus="virtio"/>
Aug 17 22:02:29 user nova-compute[72818]:     </disk>
Aug 17 22:02:29 user nova-compute[72818]:     <interface type="ethernet">
Aug 17 22:02:29 user nova-compute[72818]:       <mac address="fa:16:3e:b0:43:56"/>
Aug 17 22:02:29 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 22:02:29 user nova-compute[72818]:       <mtu size="1442"/>
Aug 17 22:02:29 user nova-compute[72818]:       <target dev="tap5149ee8c-f5"/>
Aug 17 22:02:29 user nova-compute[72818]:     </interface>
Aug 17 22:02:29 user nova-compute[72818]:     <serial type="pty">
Aug 17 22:02:29 user nova-compute[72818]:       <log file="/opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/console.log" append="off"/>
Aug 17 22:02:29 user nova-compute[72818]:     </serial>
Aug 17 22:02:29 user nova-compute[72818]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 22:02:29 user nova-compute[72818]:     <video>
Aug 17 22:02:29 user nova-compute[72818]:       <model type="virtio"/>
Aug 17 22:02:29 user nova-compute[72818]:     </video>
Aug 17 22:02:29 user nova-compute[72818]:     <rng model="virtio">
Aug 17 22:02:29 user nova-compute[72818]:       <backend model="random">/dev/urandom</backend>
Aug 17 22:02:29 user nova-compute[72818]:     </rng>
Aug 17 22:02:29 user nova-compute[72818]:     <controller type="usb" index="0" model="none"/>
Aug 17 22:02:29 user nova-compute[72818]:     <memballoon model="virtio">
Aug 17 22:02:29 user nova-compute[72818]:       <stats period="10"/>
Aug 17 22:02:29 user nova-compute[72818]:     </memballoon>
Aug 17 22:02:29 user nova-compute[72818]:   </devices>
Aug 17 22:02:29 user nova-compute[72818]: </domain>
Aug 17 22:02:29 user nova-compute[72818]:  {{(pid=72818) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T22:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1329937507',display_name='tempest-TestMinimumBasicScenario-server-1329937507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1329937507',id=52,image_ref='2eaf2462-0c8b-4cc4-ac95-e20e8af9f8c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh7gZWvKmcWfRpNLruw39/YJ3iAs75gJ/5tYSBz4Yggmgk/uJSANMCJR5aPyes6vfip5SgihZGbuzJx+55qYsI6DBOGmzjFuIFNMFTsVzuSAOtdi4mxIhoKAICg8hOqrA==',key_name='tempest-TestMinimumBasicScenario-1895059836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29887fb0e7004a0e8ae9266e24b83590',ramdisk_id='',reservation_id='r-exn2dvsp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2eaf2462-0c8b-4cc4-ac95-e20e8af9f8c7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-433210411',owner_user_name='tempest-TestMinimumBasicScenario-433210411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T22:02:27Z,user_data=None,user_id='2d34610b992e405795f5a4d71fcdee44',uuid=ce38edc9-c3d7-4187-a8aa-97e2281b15a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converting VIF {"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:43:56,bridge_name='br-int',has_traffic_filtering=True,id=5149ee8c-f57b-4fcc-b317-7cd90e54e47b,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5149ee8c-f5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG os_vif [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:43:56,bridge_name='br-int',has_traffic_filtering=True,id=5149ee8c-f57b-4fcc-b317-7cd90e54e47b,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5149ee8c-f5') {{(pid=72818) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5149ee8c-f5, may_exist=True, interface_attrs={}) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5149ee8c-f5, col_values=(('external_ids', {'iface-id': '5149ee8c-f57b-4fcc-b317-7cd90e54e47b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:43:56', 'vm-uuid': 'ce38edc9-c3d7-4187-a8aa-97e2281b15a4'}),), if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:29 user nova-compute[72818]: INFO os_vif [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:43:56,bridge_name='br-int',has_traffic_filtering=True,id=5149ee8c-f57b-4fcc-b317-7cd90e54e47b,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5149ee8c-f5')
Aug 17 22:02:29 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] No VIF found with MAC fa:16:3e:b0:43:56, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Skipping network cache update for instance because it is Building. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 22:02:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 22:02:30 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:02:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-e6ca7a7c-8620-4f3f-b6ab-67b2242c9414 req-8f5e7066-a3a7-4be2-aaea-bcb941ecb0af service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:02:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e6ca7a7c-8620-4f3f-b6ab-67b2242c9414 req-8f5e7066-a3a7-4be2-aaea-bcb941ecb0af service nova] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:02:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e6ca7a7c-8620-4f3f-b6ab-67b2242c9414 req-8f5e7066-a3a7-4be2-aaea-bcb941ecb0af service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:02:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-e6ca7a7c-8620-4f3f-b6ab-67b2242c9414 req-8f5e7066-a3a7-4be2-aaea-bcb941ecb0af service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:02:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-e6ca7a7c-8620-4f3f-b6ab-67b2242c9414 req-8f5e7066-a3a7-4be2-aaea-bcb941ecb0af service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] No waiting events found dispatching network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:02:31 user nova-compute[72818]: WARNING nova.compute.manager [req-e6ca7a7c-8620-4f3f-b6ab-67b2242c9414 req-8f5e7066-a3a7-4be2-aaea-bcb941ecb0af service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received unexpected event network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b for instance with vm_state building and task_state spawning.
Aug 17 22:02:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:02:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692309753.148788, ce38edc9-c3d7-4187-a8aa-97e2281b15a4 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 22:02:33 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] VM Resumed (Lifecycle Event)
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Instance event wait completed in 0 seconds for  {{(pid=72818) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Guest created on hypervisor {{(pid=72818) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 22:02:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Instance spawned successfully.
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Found default for hw_cdrom_bus of ide {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Found default for hw_disk_bus of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Found default for hw_input_bus of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Found default for hw_pointer_model of None {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Found default for hw_video_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Found default for hw_vif_model of virtio {{(pid=72818) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 22:02:33 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692309753.1530027, ce38edc9-c3d7-4187-a8aa-97e2281b15a4 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 22:02:33 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] VM Started (Lifecycle Event)
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 22:02:33 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 22:02:33 user nova-compute[72818]: INFO nova.compute.manager [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Took 6.15 seconds to spawn the instance on the hypervisor.
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-54ca3473-a61b-40a0-a804-6fd2784eaf78 req-e6043c1a-0c6d-4b22-b8eb-ed3019256447 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-54ca3473-a61b-40a0-a804-6fd2784eaf78 req-e6043c1a-0c6d-4b22-b8eb-ed3019256447 service nova] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-54ca3473-a61b-40a0-a804-6fd2784eaf78 req-e6043c1a-0c6d-4b22-b8eb-ed3019256447 service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-54ca3473-a61b-40a0-a804-6fd2784eaf78 req-e6043c1a-0c6d-4b22-b8eb-ed3019256447 service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.compute.manager [req-54ca3473-a61b-40a0-a804-6fd2784eaf78 req-e6043c1a-0c6d-4b22-b8eb-ed3019256447 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] No waiting events found dispatching network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:02:33 user nova-compute[72818]: WARNING nova.compute.manager [req-54ca3473-a61b-40a0-a804-6fd2784eaf78 req-e6043c1a-0c6d-4b22-b8eb-ed3019256447 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received unexpected event network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b for instance with vm_state building and task_state spawning.
Aug 17 22:02:33 user nova-compute[72818]: INFO nova.compute.manager [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Took 6.80 seconds to build instance.
Aug 17 22:02:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-bd382c0c-182b-45be-8e50-89ce9c765cf7 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.890s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:02:33 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 22:02:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:35 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:02:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:02:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:02:35 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:02:35 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 22:02:35 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:02:36 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:02:36 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:02:36 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:02:36 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:02:36 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:02:36 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8868MB free_disk=25.174114227294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 22:02:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:02:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:02:36 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ce38edc9-c3d7-4187-a8aa-97e2281b15a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 22:02:36 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 22:02:36 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 22:02:36 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 22:02:36 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 22:02:36 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 22:02:36 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:02:37 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:41 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:02:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:53 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:02:53 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Triggering sync for uuid ce38edc9-c3d7-4187-a8aa-97e2281b15a4 {{(pid=72818) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 22:02:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:02:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:02:53 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:02:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:57 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:02:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:03:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:03:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:03:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:03:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:27 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:03:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 22:03:29 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid ce38edc9-c3d7-4187-a8aa-97e2281b15a4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:03:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating instance_info_cache with network_info: [{"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:03:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:03:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 22:03:32 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:03:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:03:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:03:34 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:03:34 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 22:03:35 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:03:37 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:03:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:03:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:03:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:03:37 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 22:03:37 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:03:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:03:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:03:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:03:38 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:03:38 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:03:38 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=25.145721435546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 22:03:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:03:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:03:38 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ce38edc9-c3d7-4187-a8aa-97e2281b15a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 22:03:38 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 22:03:38 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 22:03:38 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 22:03:38 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 22:03:38 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 22:03:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:03:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:03:42 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:03:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:03:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:03:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'flavor' on Instance uuid ce38edc9-c3d7-4187-a8aa-97e2281b15a4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:04:22 user nova-compute[72818]: INFO nova.compute.manager [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Attaching volume 2462a9c9-8c8a-45ac-aecf-b329dd38222e to /dev/vdb
Aug 17 22:04:22 user nova-compute[72818]: DEBUG os_brick.utils [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade5f483-d9d3-4f4b-a2b9-ae1567ad2570]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:96e9f9b3c30\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe3cf85-c596-4c5c-9207-bb867f7dee67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[804a8d26-169b-45c4-b67d-980cff438461]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b1ba4b-8007-472c-bfa7-08e4381bcf43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Running cmd (subprocess): nvme version {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] 'nvme version' failed. Not Retrying. {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] nvme not present on system {{(pid=72818) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 22:04:22 user nova-compute[72818]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 22:04:22 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f936a1-f76e-4d55-bda5-d83ca07611dd]: (4, '') {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72818) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] LIGHTOS: no hostnqn found. {{(pid=72818) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG os_brick.utils [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:96e9f9b3c30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 22:04:22 user nova-compute[72818]: DEBUG nova.virt.block_device [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating existing volume attachment record: 1c098f17-25d7-40e6-9aca-f7f389ad3dce {{(pid=72818) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 22:04:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:04:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:04:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:04:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:04:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:04:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:04:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:04:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:30 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:04:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 22:04:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 22:04:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:04:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:04:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 22:04:30 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid ce38edc9-c3d7-4187-a8aa-97e2281b15a4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:04:31 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating instance_info_cache with network_info: [{"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:04:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:04:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Calling os-brick to attach iSCSI Volume {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FnXNuRyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 22:04:32 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 22:04:32 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 22:04:32 user nova-compute[72818]: INFO os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2ec93d-a913-4668-a0b6-2e2d8177023c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 22:04:32 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --interface default --op new {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[af252f2c-e6ca-4a23-a297-03780fd654fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e] added\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e] added
Aug 17 22:04:32 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d12fa2-c6ca-4957-a4e4-ced2b3931adf]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dd5d06-7d41-485c-b58b-3095745037ae]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FnXNuRyP {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FnXNuRyP" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[691d8d56-615f-4aef-a1c0-13510cca4950]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FnXNuRyP'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ab471b-3468-4489-a180-5c2b8c6ca389]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[358ab1ef-6dd7-4e55-902e-29e86f818894]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 22:04:32 user nova-compute[72818]:  {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 22:04:32 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 22:04:32 user nova-compute[72818]:  {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 22:04:32 user nova-compute[72818]: WARNING os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 22:04:32 user nova-compute[72818]: 
Aug 17 22:04:32 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --login {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e203f364-6dd5-41fa-9028-7c7c37386bfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e, portal: 172.16.0.220,3260]
Aug 17 22:04:33 user nova-compute[72818]: Login to [iface: default, target: iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e, portal: 172.16.0.220,3260] successful.
Aug 17 22:04:33 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35ea8a5-022e-4ef9-8f8c-24b897358167]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eb18e7-e054-420a-a99d-eb7f2387d1f3]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e (non-flash)
Aug 17 22:04:33 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e (non-flash)
Aug 17 22:04:33 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Connected to 172.16.0.220:3260 {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72818) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72818) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[40133935-9309-4d8e-87b3-89e8e3f65054]: (4, ('- - 0', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:04:33 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72818) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FnXNuRyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72818) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23436383939393062', 'path': '/dev/sdb'} {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436383939393062', 'path': '/dev/sdb'} {{(pid=72818) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG nova.objects.instance [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'flavor' on Instance uuid ce38edc9-c3d7-4187-a8aa-97e2281b15a4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 22:04:34 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 22:04:34 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 22:04:34 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 22:04:34 user nova-compute[72818]:   <serial>2462a9c9-8c8a-45ac-aecf-b329dd38222e</serial>
Aug 17 22:04:34 user nova-compute[72818]: </disk>
Aug 17 22:04:34 user nova-compute[72818]:  {{(pid=72818) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] No BDM found with device name vda, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72818) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] No VIF found with MAC fa:16:3e:b0:43:56, not building metadata {{(pid=72818) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-f8b235f0-0a24-4c3f-82e7-00ba70f8bc30 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.399s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:04:34 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:04:35 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:04:36 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:36 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:04:36 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 22:04:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-3662de17-df92-44e6-baae-f788a4c81cfb req-646013cc-b66d-4e75-bd07-5139daaa3ef1 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-changed-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:04:37 user nova-compute[72818]: DEBUG nova.compute.manager [req-3662de17-df92-44e6-baae-f788a4c81cfb req-646013cc-b66d-4e75-bd07-5139daaa3ef1 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Refreshing instance network info cache due to event network-changed-5149ee8c-f57b-4fcc-b317-7cd90e54e47b. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 22:04:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3662de17-df92-44e6-baae-f788a4c81cfb req-646013cc-b66d-4e75-bd07-5139daaa3ef1 service nova] Acquiring lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:04:37 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3662de17-df92-44e6-baae-f788a4c81cfb req-646013cc-b66d-4e75-bd07-5139daaa3ef1 service nova] Acquired lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:04:37 user nova-compute[72818]: DEBUG nova.network.neutron [req-3662de17-df92-44e6-baae-f788a4c81cfb req-646013cc-b66d-4e75-bd07-5139daaa3ef1 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Refreshing network info cache for port 5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 22:04:38 user nova-compute[72818]: DEBUG nova.network.neutron [req-3662de17-df92-44e6-baae-f788a4c81cfb req-646013cc-b66d-4e75-bd07-5139daaa3ef1 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updated VIF entry in instance network info cache for port 5149ee8c-f57b-4fcc-b317-7cd90e54e47b. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 22:04:38 user nova-compute[72818]: DEBUG nova.network.neutron [req-3662de17-df92-44e6-baae-f788a4c81cfb req-646013cc-b66d-4e75-bd07-5139daaa3ef1 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating instance_info_cache with network_info: [{"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:04:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-3662de17-df92-44e6-baae-f788a4c81cfb req-646013cc-b66d-4e75-bd07-5139daaa3ef1 service nova] Releasing lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:04:38 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:04:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:04:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:04:38 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:04:38 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 22:04:38 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG nova.compute.manager [req-814f1130-8c04-4369-9709-7f7de35bf5b0 req-3c985759-40c9-4939-b3dc-131257ebd847 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-changed-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG nova.compute.manager [req-814f1130-8c04-4369-9709-7f7de35bf5b0 req-3c985759-40c9-4939-b3dc-131257ebd847 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Refreshing instance network info cache due to event network-changed-5149ee8c-f57b-4fcc-b317-7cd90e54e47b. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-814f1130-8c04-4369-9709-7f7de35bf5b0 req-3c985759-40c9-4939-b3dc-131257ebd847 service nova] Acquiring lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-814f1130-8c04-4369-9709-7f7de35bf5b0 req-3c985759-40c9-4939-b3dc-131257ebd847 service nova] Acquired lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG nova.network.neutron [req-814f1130-8c04-4369-9709-7f7de35bf5b0 req-3c985759-40c9-4939-b3dc-131257ebd847 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Refreshing network info cache for port 5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 22:04:39 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:04:39 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:04:39 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=25.14462661743164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ce38edc9-c3d7-4187-a8aa-97e2281b15a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:04:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:04:39 user nova-compute[72818]: INFO nova.compute.manager [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Rebooting instance
Aug 17 22:04:39 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:04:40 user nova-compute[72818]: DEBUG nova.network.neutron [req-814f1130-8c04-4369-9709-7f7de35bf5b0 req-3c985759-40c9-4939-b3dc-131257ebd847 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updated VIF entry in instance network info cache for port 5149ee8c-f57b-4fcc-b317-7cd90e54e47b. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 22:04:40 user nova-compute[72818]: DEBUG nova.network.neutron [req-814f1130-8c04-4369-9709-7f7de35bf5b0 req-3c985759-40c9-4939-b3dc-131257ebd847 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating instance_info_cache with network_info: [{"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:04:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-814f1130-8c04-4369-9709-7f7de35bf5b0 req-3c985759-40c9-4939-b3dc-131257ebd847 service nova] Releasing lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:04:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquired lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:04:40 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Building network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 22:04:40 user nova-compute[72818]: DEBUG nova.network.neutron [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating instance_info_cache with network_info: [{"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:04:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Releasing lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:04:40 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 22:04:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:42 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-4b074728-e28b-4c4b-ae76-b3b6f5771315 req-5d082640-ac70-4c54-be4d-9b10f1e77282 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-vif-unplugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:04:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4b074728-e28b-4c4b-ae76-b3b6f5771315 req-5d082640-ac70-4c54-be4d-9b10f1e77282 service nova] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:04:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4b074728-e28b-4c4b-ae76-b3b6f5771315 req-5d082640-ac70-4c54-be4d-9b10f1e77282 service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:04:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-4b074728-e28b-4c4b-ae76-b3b6f5771315 req-5d082640-ac70-4c54-be4d-9b10f1e77282 service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:04:43 user nova-compute[72818]: DEBUG nova.compute.manager [req-4b074728-e28b-4c4b-ae76-b3b6f5771315 req-5d082640-ac70-4c54-be4d-9b10f1e77282 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] No waiting events found dispatching network-vif-unplugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:04:43 user nova-compute[72818]: WARNING nova.compute.manager [req-4b074728-e28b-4c4b-ae76-b3b6f5771315 req-5d082640-ac70-4c54-be4d-9b10f1e77282 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received unexpected event network-vif-unplugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b for instance with vm_state active and task_state reboot_started.
Aug 17 22:04:43 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Instance shutdown successfully.
Aug 17 22:04:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:44 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:04:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-9386b08b-2ce7-4f36-b777-99660cebfb2f req-a69bd3a2-cf21-41cf-a44d-1b44cb837081 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:04:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9386b08b-2ce7-4f36-b777-99660cebfb2f req-a69bd3a2-cf21-41cf-a44d-1b44cb837081 service nova] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:04:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9386b08b-2ce7-4f36-b777-99660cebfb2f req-a69bd3a2-cf21-41cf-a44d-1b44cb837081 service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:04:45 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-9386b08b-2ce7-4f36-b777-99660cebfb2f req-a69bd3a2-cf21-41cf-a44d-1b44cb837081 service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:04:45 user nova-compute[72818]: DEBUG nova.compute.manager [req-9386b08b-2ce7-4f36-b777-99660cebfb2f req-a69bd3a2-cf21-41cf-a44d-1b44cb837081 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] No waiting events found dispatching network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:04:45 user nova-compute[72818]: WARNING nova.compute.manager [req-9386b08b-2ce7-4f36-b777-99660cebfb2f req-a69bd3a2-cf21-41cf-a44d-1b44cb837081 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received unexpected event network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b for instance with vm_state active and task_state reboot_started.
Aug 17 22:04:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG nova.virt.libvirt.host [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Removed pending event for ce38edc9-c3d7-4187-a8aa-97e2281b15a4 due to event {{(pid=72818) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692309887.08069, ce38edc9-c3d7-4187-a8aa-97e2281b15a4 => Resumed> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 22:04:47 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] VM Resumed (Lifecycle Event)
Aug 17 22:04:47 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Instance running successfully.
Aug 17 22:04:47 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Instance soft rebooted successfully.
Aug 17 22:04:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 22:04:47 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 17 22:04:47 user nova-compute[72818]: DEBUG nova.virt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Emitting event <LifecycleEvent: 1692309887.08271, ce38edc9-c3d7-4187-a8aa-97e2281b15a4 => Started> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 22:04:47 user nova-compute[72818]: INFO nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] VM Started (Lifecycle Event)
Aug 17 22:04:47 user nova-compute[72818]: DEBUG nova.compute.manager [req-fdf43296-c0db-4d68-b1be-e91f071677d0 req-46433e1f-2734-4d2c-bb9c-cca0cb6c3c2d service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fdf43296-c0db-4d68-b1be-e91f071677d0 req-46433e1f-2734-4d2c-bb9c-cca0cb6c3c2d service nova] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fdf43296-c0db-4d68-b1be-e91f071677d0 req-46433e1f-2734-4d2c-bb9c-cca0cb6c3c2d service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fdf43296-c0db-4d68-b1be-e91f071677d0 req-46433e1f-2734-4d2c-bb9c-cca0cb6c3c2d service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG nova.compute.manager [req-fdf43296-c0db-4d68-b1be-e91f071677d0 req-46433e1f-2734-4d2c-bb9c-cca0cb6c3c2d service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] No waiting events found dispatching network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:04:47 user nova-compute[72818]: WARNING nova.compute.manager [req-fdf43296-c0db-4d68-b1be-e91f071677d0 req-46433e1f-2734-4d2c-bb9c-cca0cb6c3c2d service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received unexpected event network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b for instance with vm_state active and task_state reboot_started.
Aug 17 22:04:47 user nova-compute[72818]: DEBUG nova.compute.manager [req-fdf43296-c0db-4d68-b1be-e91f071677d0 req-46433e1f-2734-4d2c-bb9c-cca0cb6c3c2d service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fdf43296-c0db-4d68-b1be-e91f071677d0 req-46433e1f-2734-4d2c-bb9c-cca0cb6c3c2d service nova] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fdf43296-c0db-4d68-b1be-e91f071677d0 req-46433e1f-2734-4d2c-bb9c-cca0cb6c3c2d service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-fdf43296-c0db-4d68-b1be-e91f071677d0 req-46433e1f-2734-4d2c-bb9c-cca0cb6c3c2d service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG nova.compute.manager [req-fdf43296-c0db-4d68-b1be-e91f071677d0 req-46433e1f-2734-4d2c-bb9c-cca0cb6c3c2d service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] No waiting events found dispatching network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:04:47 user nova-compute[72818]: WARNING nova.compute.manager [req-fdf43296-c0db-4d68-b1be-e91f071677d0 req-46433e1f-2734-4d2c-bb9c-cca0cb6c3c2d service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received unexpected event network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b for instance with vm_state active and task_state reboot_started.
Aug 17 22:04:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-e7b2aad7-26da-4d38-b24f-ab7b91836348 tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.213s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG nova.compute.manager [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72818) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 22:04:47 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:52 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:04:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:05:02 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:07 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:12 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:17 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:05:28 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:05:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:30 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:05:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 22:05:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 22:05:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:05:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:05:30 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 22:05:30 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid ce38edc9-c3d7-4187-a8aa-97e2281b15a4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:05:31 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating instance_info_cache with network_info: [{"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:05:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:05:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 22:05:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:05:34 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:05:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:05:36 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:05:37 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:05:37 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:05:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 22:05:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:40 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:05:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:05:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:05:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:05:40 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 22:05:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72818) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 22:05:41 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:05:41 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:05:41 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=25.143104553222656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ce38edc9-c3d7-4187-a8aa-97e2281b15a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 22:05:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:05:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:45 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:05:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:05:57 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:05:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:29 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:06:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:06:30 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:06:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 22:06:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquired lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Forcefully refreshing network info cache for instance {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG nova.objects.instance [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lazy-loading 'info_cache' on Instance uuid ce38edc9-c3d7-4187-a8aa-97e2281b15a4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG nova.network.neutron [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating instance_info_cache with network_info: [{"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Releasing lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updated the network info_cache for instance {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-7d7ad8d6-cf75-4bd7-add4-e7f46fba3770 req-a812a6bc-2773-441f-b419-fecc66d4eebd service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-changed-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG nova.compute.manager [req-7d7ad8d6-cf75-4bd7-add4-e7f46fba3770 req-a812a6bc-2773-441f-b419-fecc66d4eebd service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Refreshing instance network info cache due to event network-changed-5149ee8c-f57b-4fcc-b317-7cd90e54e47b. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7d7ad8d6-cf75-4bd7-add4-e7f46fba3770 req-a812a6bc-2773-441f-b419-fecc66d4eebd service nova] Acquiring lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7d7ad8d6-cf75-4bd7-add4-e7f46fba3770 req-a812a6bc-2773-441f-b419-fecc66d4eebd service nova] Acquired lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG nova.network.neutron [req-7d7ad8d6-cf75-4bd7-add4-e7f46fba3770 req-a812a6bc-2773-441f-b419-fecc66d4eebd service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Refreshing network info cache for port 5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 22:06:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG nova.network.neutron [req-7d7ad8d6-cf75-4bd7-add4-e7f46fba3770 req-a812a6bc-2773-441f-b419-fecc66d4eebd service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updated VIF entry in instance network info cache for port 5149ee8c-f57b-4fcc-b317-7cd90e54e47b. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG nova.network.neutron [req-7d7ad8d6-cf75-4bd7-add4-e7f46fba3770 req-a812a6bc-2773-441f-b419-fecc66d4eebd service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating instance_info_cache with network_info: [{"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-7d7ad8d6-cf75-4bd7-add4-e7f46fba3770 req-a812a6bc-2773-441f-b419-fecc66d4eebd service nova] Releasing lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-a63af820-5989-43d9-ac5b-6d18b90be7b4 req-fbad98c3-2bd8-44b3-92ba-501bc7e33a34 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-changed-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-a63af820-5989-43d9-ac5b-6d18b90be7b4 req-fbad98c3-2bd8-44b3-92ba-501bc7e33a34 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Refreshing instance network info cache due to event network-changed-5149ee8c-f57b-4fcc-b317-7cd90e54e47b. {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a63af820-5989-43d9-ac5b-6d18b90be7b4 req-fbad98c3-2bd8-44b3-92ba-501bc7e33a34 service nova] Acquiring lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a63af820-5989-43d9-ac5b-6d18b90be7b4 req-fbad98c3-2bd8-44b3-92ba-501bc7e33a34 service nova] Acquired lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG nova.network.neutron [req-a63af820-5989-43d9-ac5b-6d18b90be7b4 req-fbad98c3-2bd8-44b3-92ba-501bc7e33a34 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Refreshing network info cache for port 5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:06:32 user nova-compute[72818]: INFO nova.compute.manager [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Detaching volume 2462a9c9-8c8a-45ac-aecf-b329dd38222e
Aug 17 22:06:32 user nova-compute[72818]: INFO nova.virt.block_device [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Attempting to driver detach volume 2462a9c9-8c8a-45ac-aecf-b329dd38222e from mountpoint /dev/vdb
Aug 17 22:06:32 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Attempting to detach device vdb from instance ce38edc9-c3d7-4187-a8aa-97e2281b15a4 from the persistent domain config. {{(pid=72818) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 22:06:32 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 22:06:32 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 22:06:32 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 22:06:32 user nova-compute[72818]:   <serial>2462a9c9-8c8a-45ac-aecf-b329dd38222e</serial>
Aug 17 22:06:32 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 22:06:32 user nova-compute[72818]: </disk>
Aug 17 22:06:32 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 22:06:32 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Successfully detached device vdb from instance ce38edc9-c3d7-4187-a8aa-97e2281b15a4 from the persistent domain config.
Aug 17 22:06:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce38edc9-c3d7-4187-a8aa-97e2281b15a4 from the live domain config. {{(pid=72818) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 22:06:32 user nova-compute[72818]: DEBUG nova.virt.libvirt.guest [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 22:06:32 user nova-compute[72818]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 22:06:32 user nova-compute[72818]:   <source dev="/dev/sdb"/>
Aug 17 22:06:32 user nova-compute[72818]:   <target dev="vdb" bus="virtio"/>
Aug 17 22:06:32 user nova-compute[72818]:   <serial>2462a9c9-8c8a-45ac-aecf-b329dd38222e</serial>
Aug 17 22:06:32 user nova-compute[72818]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 22:06:32 user nova-compute[72818]: </disk>
Aug 17 22:06:32 user nova-compute[72818]:  {{(pid=72818) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG nova.network.neutron [req-a63af820-5989-43d9-ac5b-6d18b90be7b4 req-fbad98c3-2bd8-44b3-92ba-501bc7e33a34 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updated VIF entry in instance network info cache for port 5149ee8c-f57b-4fcc-b317-7cd90e54e47b. {{(pid=72818) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG nova.network.neutron [req-a63af820-5989-43d9-ac5b-6d18b90be7b4 req-fbad98c3-2bd8-44b3-92ba-501bc7e33a34 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating instance_info_cache with network_info: [{"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-a63af820-5989-43d9-ac5b-6d18b90be7b4 req-fbad98c3-2bd8-44b3-92ba-501bc7e33a34 service nova] Releasing lock "refresh_cache-ce38edc9-c3d7-4187-a8aa-97e2281b15a4" {{(pid=72818) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-0a99d147-e211-4b9b-adae-dc617e8932ae None None] Received event <DeviceRemovedEvent: 1692309993.2804136, ce38edc9-c3d7-4187-a8aa-97e2281b15a4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72818) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.driver [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce38edc9-c3d7-4187-a8aa-97e2281b15a4 {{(pid=72818) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 22:06:33 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Successfully detached device vdb from instance ce38edc9-c3d7-4187-a8aa-97e2281b15a4 from the live domain config.
Aug 17 22:06:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] calling os-brick to detach iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8f2855b730>, {'target_iqns': ['iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FnXNuRyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 22:06:33 user nova-compute[72818]: WARNING os_brick.initiator.connectors.base [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e', 0)] {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ea0595-8780-4533-9721-9008e9b3f897]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd819ff-149a-4473-a344-07ef8d050511]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e (non-flash)\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e (non-flash)
Aug 17 22:06:33 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e (non-flash)
Aug 17 22:06:33 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8f04da37f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e'): ({'sdb'}, set())}) {{(pid=72818) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Removing single pathed devices sdb {{(pid=72818) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63a8a80-f1d7-4eaa-bbea-40adbc7d6d45]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd050ef-cb01-476c-bce4-1e2d09f11d94]: (4, ('ok\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Flushing IO for device /dev/sdb {{(pid=72818) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c71e8e-c034-4a89-9929-0cfa305dfa4a]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72818) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1166ed-7d3c-40c3-9f84-dea17a75e4a2]: (4, ('1', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.linuxscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] SCSI volumes sdb have been removed. {{(pid=72818) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e')] {{(pid=72818) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d80b434-a803-4402-b0ca-4606014f9218]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --logout {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faae9f6-d87e-4e3a-a7a8-aae829d8298a]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e, portal: 172.16.0.220,3260]
Aug 17 22:06:33 user nova-compute[72818]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e, portal: 172.16.0.220,3260] successful.
Aug 17 22:06:33 user nova-compute[72818]:  stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op delete {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2462a9c9-8c8a-45ac-aecf-b329dd38222e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83620) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d74caa-e8db-4631-a73f-cc66b2a3afa6]: (4, ('', '')) {{(pid=83620) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72818) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.base [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.241s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] <== disconnect_volume: return (242ms) None {{(pid=72818) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 22:06:33 user nova-compute[72818]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Disconnected iSCSI Volume {{(pid=72818) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 22:06:34 user nova-compute[72818]: DEBUG nova.objects.instance [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'flavor' on Instance uuid ce38edc9-c3d7-4187-a8aa-97e2281b15a4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:06:34 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-9e456b6f-9731-4c38-b3ba-68fea9ae443a tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.582s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:06:34 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:35 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:06:36 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:06:37 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:06:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 22:06:39 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:06:39 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:40 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:06:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:06:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:06:40 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:06:40 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 22:06:40 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:06:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:06:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 22:06:41 user nova-compute[72818]: DEBUG oslo_concurrency.processutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 22:06:41 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:06:41 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:06:41 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=25.14234161376953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 22:06:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:06:41 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:06:41 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Instance ce38edc9-c3d7-4187-a8aa-97e2281b15a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72818) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 22:06:41 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 22:06:41 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 22:06:41 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing inventories for resource provider d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 22:06:41 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating ProviderTree inventory for provider d156e3af-684d-47e1-a951-585f9c95fa46 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 22:06:41 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Updating inventory in ProviderTree for provider d156e3af-684d-47e1-a951-585f9c95fa46 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 22:06:41 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing aggregate associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, aggregates: None {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 22:06:42 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Refreshing trait associations for resource provider d156e3af-684d-47e1-a951-585f9c95fa46, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND {{(pid=72818) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 22:06:42 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 22:06:42 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 22:06:42 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 22:06:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:06:42 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:06:44 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:47 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:06:49 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:06:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:06:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 22:06:50 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] There are 0 instances to clean {{(pid=72818) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 22:06:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:06:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:06:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:06:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:06:54 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:06:55 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:06:55 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72818) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 22:06:59 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:04 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:07:09 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:14 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:07:19 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:07:24 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:07:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:07:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:07:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:07:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:07:29 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:07:29 user nova-compute[72818]: INFO nova.compute.manager [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Terminating instance
Aug 17 22:07:29 user nova-compute[72818]: DEBUG nova.compute.manager [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Start destroying the instance on the hypervisor. {{(pid=72818) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 22:07:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:29 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-23f77d79-3600-43e8-9e18-8e0b8c8aa5d7 req-3d38396d-a9c8-407d-a5fb-31e664e54a7e service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-vif-unplugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-23f77d79-3600-43e8-9e18-8e0b8c8aa5d7 req-3d38396d-a9c8-407d-a5fb-31e664e54a7e service nova] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-23f77d79-3600-43e8-9e18-8e0b8c8aa5d7 req-3d38396d-a9c8-407d-a5fb-31e664e54a7e service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-23f77d79-3600-43e8-9e18-8e0b8c8aa5d7 req-3d38396d-a9c8-407d-a5fb-31e664e54a7e service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-23f77d79-3600-43e8-9e18-8e0b8c8aa5d7 req-3d38396d-a9c8-407d-a5fb-31e664e54a7e service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] No waiting events found dispatching network-vif-unplugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.compute.manager [req-23f77d79-3600-43e8-9e18-8e0b8c8aa5d7 req-3d38396d-a9c8-407d-a5fb-31e664e54a7e service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-vif-unplugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b for instance with task_state deleting. {{(pid=72818) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:30 user nova-compute[72818]: INFO nova.virt.libvirt.driver [-] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Instance destroyed successfully.
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.objects.instance [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lazy-loading 'resources' on Instance uuid ce38edc9-c3d7-4187-a8aa-97e2281b15a4 {{(pid=72818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.virt.libvirt.vif [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T22:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1329937507',display_name='tempest-TestMinimumBasicScenario-server-1329937507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1329937507',id=52,image_ref='2eaf2462-0c8b-4cc4-ac95-e20e8af9f8c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh7gZWvKmcWfRpNLruw39/YJ3iAs75gJ/5tYSBz4Yggmgk/uJSANMCJR5aPyes6vfip5SgihZGbuzJx+55qYsI6DBOGmzjFuIFNMFTsVzuSAOtdi4mxIhoKAICg8hOqrA==',key_name='tempest-TestMinimumBasicScenario-1895059836',keypairs=<?>,launch_index=0,launched_at=2023-08-17T22:02:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29887fb0e7004a0e8ae9266e24b83590',ramdisk_id='',reservation_id='r-exn2dvsp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2eaf2462-0c8b-4cc4-ac95-e20e8af9f8c7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-433210411',owner_user_name='tempest-TestMinimumBasicScenario-433210411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T22:04:47Z,user_data=None,user_id='2d34610b992e405795f5a4d71fcdee44',uuid=ce38edc9-c3d7-4187-a8aa-97e2281b15a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converting VIF {"id": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "address": "fa:16:3e:b0:43:56", "network": {"id": "cb368cd8-7930-47cc-a3d3-cb7905832b5a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1912900937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29887fb0e7004a0e8ae9266e24b83590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5149ee8c-f5", "ovs_interfaceid": "5149ee8c-f57b-4fcc-b317-7cd90e54e47b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.network.os_vif_util [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:43:56,bridge_name='br-int',has_traffic_filtering=True,id=5149ee8c-f57b-4fcc-b317-7cd90e54e47b,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5149ee8c-f5') {{(pid=72818) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG os_vif [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:43:56,bridge_name='br-int',has_traffic_filtering=True,id=5149ee8c-f57b-4fcc-b317-7cd90e54e47b,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5149ee8c-f5') {{(pid=72818) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5149ee8c-f5, bridge=br-int, if_exists=True) {{(pid=72818) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:07:30 user nova-compute[72818]: INFO os_vif [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:43:56,bridge_name='br-int',has_traffic_filtering=True,id=5149ee8c-f57b-4fcc-b317-7cd90e54e47b,network=Network(cb368cd8-7930-47cc-a3d3-cb7905832b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5149ee8c-f5')
Aug 17 22:07:30 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Deleting instance files /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4_del
Aug 17 22:07:30 user nova-compute[72818]: INFO nova.virt.libvirt.driver [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Deletion of /opt/stack/data/nova/instances/ce38edc9-c3d7-4187-a8aa-97e2281b15a4_del complete
Aug 17 22:07:30 user nova-compute[72818]: INFO nova.compute.manager [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 22:07:30 user nova-compute[72818]: DEBUG oslo.service.loopingcall [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72818) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.compute.manager [-] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Deallocating network for instance {{(pid=72818) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] deallocate_for_instance() {{(pid=72818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Skipping network cache update for instance because it is being deleted. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 22:07:30 user nova-compute[72818]: DEBUG nova.network.neutron [-] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Updating instance_info_cache with network_info: [] {{(pid=72818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 22:07:30 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Took 0.55 seconds to deallocate network for instance.
Aug 17 22:07:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:07:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:07:31 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 22:07:31 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 22:07:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:07:31 user nova-compute[72818]: INFO nova.scheduler.client.report [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Deleted allocations for instance ce38edc9-c3d7-4187-a8aa-97e2281b15a4
Aug 17 22:07:31 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-60141601-bde6-41b5-9c1c-a8c0a0bd58df tempest-TestMinimumBasicScenario-433210411 tempest-TestMinimumBasicScenario-433210411-project-member] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.711s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:07:31 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:07:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-cf8a2668-0fd1-4f90-afc2-b2c17ffe6519 req-ba6bd415-aecd-4f85-b2b3-3bbc4c2ba897 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:07:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cf8a2668-0fd1-4f90-afc2-b2c17ffe6519 req-ba6bd415-aecd-4f85-b2b3-3bbc4c2ba897 service nova] Acquiring lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:07:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cf8a2668-0fd1-4f90-afc2-b2c17ffe6519 req-ba6bd415-aecd-4f85-b2b3-3bbc4c2ba897 service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:07:32 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [req-cf8a2668-0fd1-4f90-afc2-b2c17ffe6519 req-ba6bd415-aecd-4f85-b2b3-3bbc4c2ba897 service nova] Lock "ce38edc9-c3d7-4187-a8aa-97e2281b15a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:07:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-cf8a2668-0fd1-4f90-afc2-b2c17ffe6519 req-ba6bd415-aecd-4f85-b2b3-3bbc4c2ba897 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] No waiting events found dispatching network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 22:07:32 user nova-compute[72818]: WARNING nova.compute.manager [req-cf8a2668-0fd1-4f90-afc2-b2c17ffe6519 req-ba6bd415-aecd-4f85-b2b3-3bbc4c2ba897 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received unexpected event network-vif-plugged-5149ee8c-f57b-4fcc-b317-7cd90e54e47b for instance with vm_state deleted and task_state None.
Aug 17 22:07:32 user nova-compute[72818]: DEBUG nova.compute.manager [req-cf8a2668-0fd1-4f90-afc2-b2c17ffe6519 req-ba6bd415-aecd-4f85-b2b3-3bbc4c2ba897 service nova] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Received event network-vif-deleted-5149ee8c-f57b-4fcc-b317-7cd90e54e47b {{(pid=72818) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 22:07:32 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:07:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:36 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:07:36 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:07:37 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:07:37 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 22:07:39 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:07:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:07:42 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:07:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:07:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:07:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:07:42 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 22:07:43 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:07:43 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:07:43 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=25.16965103149414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 22:07:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:07:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:07:43 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 22:07:43 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 22:07:43 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 22:07:43 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 22:07:43 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 22:07:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:07:45 user nova-compute[72818]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692310050.3379576, ce38edc9-c3d7-4187-a8aa-97e2281b15a4 => Stopped> {{(pid=72818) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 22:07:45 user nova-compute[72818]: INFO nova.compute.manager [-] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] VM Stopped (Lifecycle Event)
Aug 17 22:07:45 user nova-compute[72818]: DEBUG nova.compute.manager [None req-a26264cf-e0cd-4356-8f61-0066e1aa3566 None None] [instance: ce38edc9-c3d7-4187-a8aa-97e2281b15a4] Checking state {{(pid=72818) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 22:07:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:07:48 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:07:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:07:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:07:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:07:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:07:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:07:55 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:08:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:08:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:08:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:08:00 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:00 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:08:05 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:08:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:08:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:08:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:08:10 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:15 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:08:20 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:23 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:25 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:27 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:30 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:32 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:08:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Starting heal instance info cache {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 22:08:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Rebuilding the list of instances to heal {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 22:08:32 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Didn't find any instances for network info cache update. {{(pid=72818) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 22:08:32 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:08:33 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:08:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:08:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:08:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:08:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:08:35 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:36 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:08:37 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:08:39 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:08:39 user nova-compute[72818]: DEBUG nova.compute.manager [None req-ec047c48-232c-432a-9a01-f898647c802f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72818) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 22:08:40 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:40 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:08:42 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 22:08:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:08:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:08:42 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:08:42 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Auditing locally available compute resources for user (node: user) {{(pid=72818) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 22:08:43 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:08:43 user nova-compute[72818]: WARNING nova.virt.libvirt.driver [None req-ec047c48-232c-432a-9a01-f898647c802f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 22:08:43 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Hypervisor/Node resource view: name=user free_ram=9049MB free_disk=25.20694351196289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72818) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 22:08:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 22:08:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 22:08:43 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 22:08:43 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72818) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 22:08:43 user nova-compute[72818]: DEBUG nova.compute.provider_tree [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed in ProviderTree for provider: d156e3af-684d-47e1-a951-585f9c95fa46 {{(pid=72818) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 22:08:43 user nova-compute[72818]: DEBUG nova.scheduler.client.report [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Inventory has not changed for provider d156e3af-684d-47e1-a951-585f9c95fa46 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72818) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 22:08:43 user nova-compute[72818]: DEBUG nova.compute.resource_tracker [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Compute_service record updated for user:user {{(pid=72818) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 22:08:43 user nova-compute[72818]: DEBUG oslo_concurrency.lockutils [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=72818) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 22:08:45 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:08:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 22:08:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72818) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 22:08:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:08:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72818) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 22:08:50 user nova-compute[72818]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72818) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 22:08:50 user nova-compute[72818]: DEBUG oslo_service.periodic_task [None req-ec047c48-232c-432a-9a01-f898647c802f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72818) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}